As someone who researched AI pre-GPT to enhance human creativity and aid in creative workflows, it’s sad for me to see the direction it’s been marketed, but not surprised. I’m personally excited by the tech because I personally see a really positive place for it where the data usage is arguably justified, but we either need to break through the current applications of it which seems more aimed at stock prices and wow-factoring the public instead of using them for what they’re best at.

The whole exciting part of these was that it could convert unstructured inputs into natural language and structured outputs. Translation tasks (broad definition of translation), extracting key data points in unstructured data, language tasks. It’s outstanding for the NLP tasks we struggled with previously, and these tasks are highly transformative or any inputs, it purely relies on structural patterns. I think few people would argue NLP tasks are infringing on the copyright owner.

But I can at least see how moving the direction toward (particularly with MoE approaches) using Q&A data to support generating Q&A outputs, media data to support generating media outputs, using code data to support generating code, this moves toward the territory of affecting sales and using someone’s IP to compete against them. From a technical perspective, I understand how LLMs are not really copying, but the way they are marketed and tuned seems to be more and more intended to use people’s data to compete against them, which is dubious at best.

Not to fully argue against your point, but I do want to push back on the citations bit. Given the way an LLM is trained, it’s not really close to equivalent to me citing papers researched for a paper. That would be more akin to asking me to cite every piece of written or verbal media I’ve ever encountered as they all contributed in some small way to way that the words were formulated here.

Now, if specific data were injected into the prompt, or maybe if it was fine-tuned on a small subset of highly specific data, I would agree those should be cited as they are being accessed more verbatim. The whole “magic” of LLMs was that it needed to cross a threshold of data, combined with the attentional mechanism, and then the network was pretty suddenly able to maintain coherent sentences structure. It was only with loads of varied data from many different sources that this really emerged.

I’ll say, one thing that helped me here was starting to see the “depth in the breadth”, so to speak, and recognizing this jumping around for what it was. A lot of novelty seeking and bouncing between hobbies to avoid conscious regulating, which was tiring.

Now, in things that I consider important, I try to find the novelty and breadth that comes with sticking to it for a long time - stare at a hobby / occupation long enough to see the big world inside of it and realize it’s more than you can take in and take time to put up some blinders so you can hone in there and see it as lots of cool novel things within a smaller space.

Also, realizing that bouncing around to all kinds of things… well, that’s my form of relaxing. If I’m totally depleted, chances are what I need isn’t to sit in one place and “rest”, or to focus on one thing, it’s to schedule time to completely not focus on one thing and allow myself to bounce all over the place and do whatever feels good (within responsible limits). It’s usually a chaotic mess that amounts to no long-term benefit, but it’s much more resting that trying to relax. Trying was the problem, after all.

Yeah, this is the approach people are trying to take more now, the problem is generally amount of that data needed and verifying it’s high quality in the first place, but these systems are positive feedback loops both in training and in use. If you train on higher quality code, it will write higher quality code, but be less able to handle edge cases or potentially complete code in a salient way that wasn’t at the same quality bar or style as the training code.

On the use side, if you provide higher quality code as input when prompting, it is more likely to predict higher quality code because it’s continuing what was written. Using standard approaches, documenting, just generally following good practice with code before sending it to the LLM will majorly improve results.

Every time. Try to get ahead of your work? Well, good for you, that first 20% went really well, now let’s spend the next two weeks on “work” that interferes with your other needs and needs to get thrown out because there’s no way it’s integrating with the other 80% that needs to happen within the next hour and also everything that you did for the other 20% is useless and needs to be redone now that you broke it with that tangent.

It’s been a painful summer “preparing” to teach my fall courses.

Yeah, Barkley’s talks have helped a lot so far. Previous psychiatrists largely wrote off diagnoses because I was successful in work, but overlooked the challenges at home. Some trauma therapy combined with Barkley’s unique focus of adult symptoms of ADHD really opened my eyes to it.

Still doubts, still confusion, but clearing up.

deleted by creator

I’m really torn on this, because on one hand the over generalization of ADHD prevented me - and is still preventing me - from taking my own diagnosis too seriously, but that same information got me to at least think about it and get a consult with a psychiatrist on it in the first place.

It helped the diagnosis but not the feelings of being an imposter post-diagnosis.

I appreciate the comment, and it’s a point I’ll be making this year in my courses. More than ever, students have been struggling to motivate themselves to do the work. The world’s on fire and it’s hard to intrinsically motivate to do hard things for the sake of learning, I get it. Get a degree to get a job to survive, learning is secondary. But this survival mindset means that the easiest way is the best way, and it’s going to crumble long-term.

It’s like jumping into an MMORPG and using a bot to play the whole game. Sure you have a cap level character, but you have no idea how to play, how to build a character, and you don’t get any of the references anyone else is making.

This is a very output-driven perspective. Another comment put it well, but essentially when we set up our curriculum we aren’t just trying to get you to produce the one or two assignments that the AI could generate - we want you to go through the motions and internalize secondary skills. We’ve set up a four year curriculum for you, and the kinds of skills you need to practice evolve over that curriculum.

This is exactly the perspective I’m trying to get at work my comment - if you go to school to get a certification to get a job and don’t care at all about the learning, of course it’s nonsense to “waste your time” on an assignment that ChatGPT can generate for you. But if you’re there to learn and develop a mastery, the additional skills you would have picked up by doing the hard thing - and maybe having a Chat AI support you in a productive way - is really where the learning is.

If 5 year olds can generate a university level essay on the implications of thermodynamics on quantum processing using AI, that’s fun, but does the 5 year old even know if that’s a coherent thesis? Does it imply anything about their understanding of these fields? Are they able to connect this information to other places?

Learning is an intrinsic task that’s been turned into a commodity. Get a degree to show you can generate that thing your future boss wants you to generate. Knowing and understanding is secondary. This is the fear of generative AI - further losing sight that we learn though friction and the final output isn’t everything. Note that this is coming from a professor that wants to mostly do away with grades, but recognizes larger systemic changes need to happen.

100%, and this is really my main point. Because it should be hard and tedious, a student who doesn’t really want to learn - or doesn’t have trust in their education - will bypass those tedious bits with the AI rather than going through those tedious, auxiliary skills that you’re expected to pick up, and use the AI was a personal tutor - not a replacement for those skills.

So often students are concerned about getting a final grade, a final result, and think that was the point, thus, “If ChatGPT can just give me the answer what was the point”, but no, there were a bunch of skills along the way that are part of the scaffolding and you’ve bypassed them through improper use of available tools. For example, in some of our programming classes we intentionally make you use worse tools early to provide a fundamental understanding of the evolution of the language ergonomics or to understand the underlying processes that power the more advanced, but easier to use, concepts. It helps you generalize later, so that you don’t just learn how to solve this problem in this programming language, but you learn how to solve the problem in a messy way that translates to many languages before you learn the powerful tools of this language. As a student, you may get upset you’re using something tedious or out of date, but as a mentor I know it’s a beneficial step in your learning career.

Maybe it would help to teach students about learning early, and how learning works.

Yeah, I knew freelance folks who provided long term support with such complicated setups. The base daily rate plus hourly with a monthly retainer and weekly on call fees. Wild.

Or, hourly = extremely high paid contract work.

Education has a fundamental incentive problem. I want to embrace AI in my classroom. I’ve been studying ways of using AI for personalized education since I was in grade school. I wanted personalized education, the ability to learn off of any tangent I wanted, to have tools to help me discover what I don’t know so I could go learn it.

The problem is, I’m the minority. Many of my students don’t want to be there. They want a job in the field, but don’t want to do the work. Your required course isn’t important to them, because they aren’t instructional designers who recognize that this mandatory tangent is scaffolding the next four years of their degree. They have a scholarship, and can’t afford to fail your assignment to get feedback. They have too many courses, and have to budget which courses to ignore. The university holds a duty to validate that those passing the courses met a level of standards and can reproduce their knowledge outside of a classroom environment. They have a strict timeline - every year they don’t certify their knowledge to satisfaction is a year of tuition and random other fees to pay.

If students were going to university to learn, or going to highschool to learn, instead of being forced there by societal pressures - if they were allowed to learn at their own pace without fear of financial ruin - if they were allowed to explore the topics they love instead of the topics that are financially sound - then there would be no issue with any of these tools. But the truth is much bleaker.

Great students are using these tools in astounding ways to learn, to grow, to explore. Other students - not bad necessarily, but ones with pressures that make education motivated purely by extrinsic factors than intrinsic - have a perfect crutch available to accidentally bypass the necessary steps of learning. Because learning can be hard, and tedious, and expensive, and if you don’t love it, you’ll take the path of least resistance.

In game design, we talk about not giving the player the tools to optimize their fun away. I love the new wave of AI, I’ve been waiting for this level of natural language processing and generation capability for a very long time, but these are the tools for students to optimize the learning away. We need to reframe learning and education. We need to bring learning front and center instead of certification. Employers need to recognize this, universities need to recognize this, highschools and students and parents need to recognize this.

Windows 11 has tabbed file explorer, a package manager, it’s quick, the interface looks nice and feels nice, and it’s been really stable for me. I don’t know where the complaints are at, it’s been great. All they need to do is regress all of the ads-in-your-OS stuff from 10. Bring back the start menu that doesn’t hang for 30 seconds looking something up online before showing you your installed programs.

I’ve gotten by too long and too successfully letting my impulses keep everything chugging along well enough that now that there’s a massive range of responsibility, dependence upon me, and deadlines with major consequences, hoping I’ll impulsively get around to things had begun putting a painful spotlight on previously undiagnosed ADHD.

I think the key to learning is to not do the thing out of impulse, but to train setting a goal of doing the thing and then painstakingly doing nothing until that thing is done. That’s the skill to train, not the thing that’s getting done.

But now, I’ll just wait for the time that that skill is the impulsive thing to work on and keep on keeping on.

Yeah, I think this is an important thing to be aware of. I 100% get and understand the need to reinforce self-worth outside of what’s traditionally pushed. But that’s not the whole story, and I don’t see much on the other side of it.

It’s when you get that anxiety/depression cocktail alongside things, unable to find the motivation to do the things you need to do to feel adequately drained, or unable to do the things that adequately energize.

It’s when you fall flat and feel horrible, not because of a corporate agenda, but because real people depended on you and you couldn’t show up.

It’s when you took the advice, and followed your rhythms of the day, and stopped going against your mental grain… and then you missed your work deadline, or messed up your work and screwed someone over, or accidentally estranged family members, or didn’t get that medical treatment you needed.

It’s really important people don’t tie up in the self-worth of productivity and corporations - it’s really easy to prioritize those because we’re told all of our lives that they’re worth prioritizing - and that leads to us ignoring our own needs… But unless you’re very fortunate, work and productivity are needs, and finding ways to exert energy in a healthy (and often relaxing!) way is important.

I don’t know where I’m going with this.

Yeah, just posted another comment, but I have my bottle flipping trick. If it’s upright before the afternoon, I didn’t take it. I take it, and flip the bottle upside down. Then if I see the bottle upside down after noon, I flip it upright.

I still have days where I need to try to mentally piece together, “Did I drink water? How thirsty was I? Was I really thirsty, and just drank to hydrate and NOT take my pill or did I drink to take the pill and forgot to flip it? Did I take it and just forget to eat? How much have I been singing on repeat this morning?”

This mouse? Believe it or not, file.

My psychiatrist booked me after 7PM on a Sunday 🙃