Yep, if anyone didn't want their videos to be on our site, we would take it down.
Just watched the video, I don't initially agree with his take completely but do totally respect the viewpoint and think a payment split to the creator whenever someone summarizes the video makes sense.
Yes we do offer the option to summarize content without creator buy-in, although it seems a bit different since we're also augmenting the content with questions etc. which should drive users to watch the video even more as opposed to skip it and just read the summary.
But you're right it's not perfect. If we ever have creators who don't want their stuff on our site we'd totally respect their wishes, but that hasn't been the case right now so this seems like the best thing to do.
> I don't think that's true? We're embedding the videos, which is allowed.
Are you not still making derivative content of the work without the copyright holder's permission? A judge might not care that much whether the video is embedded or not.
> Yep, if anyone didn't want their videos to be on our site, we would take it down.
Do note that this behavior of "opting creators into a program without their consent, justifying it via revenue share, and CYA with a 'they can opt out if they want to!' shield" is still... awful optics.
Thanks! Definitely some potential, we actually built a language learning tool for a few days early on (but decided that it was too crowded of a space to start in).
Learning languages seems a bit different in that there's more focus on repetition compared to comprehension questions, but there are certain topics (like grammar concepts) that could work well in our current structure. Also there are some really popular YouTube channels for learning any language, so we definitely see a potential to augment those videos to more accurately & effectively learn.
For official courses, we go over the generated course with the creator to vet the content. Generally they're pretty impressed but have a few things they'd like to change/add before publishing.
For self-created courses, it's generally been quite accurate and we're playing around with some eval metrics to make it as good as possible, but it's definitely a concern.
Is the course creator being impressed the most important metric? Are there other more concrete metrics you are able to use to determine quality from the perspective of a student?
I am curious if you are using any methodologies from the digital learning space like knowledge tracing to help ensure that learners are actually retaining knowledge and improving over time or knowledge mapping to understand the gaps that might exist in your content?
Do you maintain your own skills taxonomy? Are you tagging your questions or assessment events with knowledge components or skills of any kind to understand what you are testing your students for?
All of this is really cool, I’m just curious at what level you’ve gotten to on some of this because there is a very fine line in online educational content between making the students life more difficult and actually helping them learn, especially when you get into auto-generating content, and especially if you aren’t following solid principles to verify your content. (I work for an online education company and particularly in the space of training LLMs and verifying their outputs for use in educational contexts)
At this stage it seems like a good metric since it's the creator's content. We're adding a feature for question feedback from users, so they can like/dislike/report questions, but very open to other metrics if you have any ideas.
Yep—also in the process of adding learning paths for certain subjects, so you can go from an introductory course to more advanced topics and fill in gaps in understanding. Agreed: our mission is to help students actually learn in the best way possible, we have individual courses now to start out but the goal is to integrate the learning experience.
Very curious to chat about what you guys do, and if you have recs for any literature in the space that we should look at.
- For official courses the creators are doing some quality control and do necessary fixes.
- For self-created courses there is zero human supervision or quality control.
Yes for the first, technically yes for the second? The user can go in and change the content as well (i.e. if it's a teacher generating a course for students). But not sure what other human supervision + quality control methods you're referring to that we could implement.
Just watched the video, I don't initially agree with his take completely but do totally respect the viewpoint and think a payment split to the creator whenever someone summarizes the video makes sense.
Yes we do offer the option to summarize content without creator buy-in, although it seems a bit different since we're also augmenting the content with questions etc. which should drive users to watch the video even more as opposed to skip it and just read the summary.
But you're right it's not perfect. If we ever have creators who don't want their stuff on our site we'd totally respect their wishes, but that hasn't been the case right now so this seems like the best thing to do.