• Silmathoron ⁂@floss.social
    link
    fedilink
    arrow-up
    9
    ·
    edit-2
    2 months ago

    @Cr4yfish nice project 🙂
    I’m a bit worried about the AI part, though, as you’d want an app whose main purpose is “learning” to guarantee, if not the reliability of the material (since anyone can contribute), at least the reliability of the course generation process that it proposes.
    As far as I know, this is not possible with current generative AI tools, so what’s your plan to make sure hallucinations do not creep in?

    • Cr4yfish@lemmy.worldOP
      link
      fedilink
      arrow-up
      5
      arrow-down
      1
      ·
      2 months ago

      Thanks. My general strategy regarding GenAI and reducing the amount of hallucinations is by not giving it the task to make stuff up, but to just work on existing text - that’s why I’m not allowing users to create content without source material.

      However, LLMs will be LLMs and I’ve been testing it out a lot and found already multiple hallucinations. I built in a reporting system, although only reporting stuff works right now, not viewing reported questions.

      That’s my short term plan to get a good content quality, at least. I also want to move away from Vercel AI & Gemini to a Langchain Agent system or Graph maybe, which will increase the output Quality.

      Maybe in some parallel Universe this really takes off and many people work on high quality Courses together…