(Sorry for the shameless self-promotion.) I'm building an app _conceptually similar_, but with an AI on top, so you get a chat/assistant with your personal context. https://github.com/superegodev/superego (Warning: still in alpha.)
Really nice. Thanks for self promo! Will definitely keep an eye on your project.
What is the ideal final state you want to achieve?
Do you agree that data capture is the main issue here?
My latest experiments:
2 days ago I started to capture screenshots of my mac every 5 seconds and later use it to approximately tell me what I'm doing. - a lot of issues with this approach.
Yesterday I setup ActivityWatch. It captures a lot of stuff from the get go. TBD if it can capture background YouTube video playing in addition to the active tab.
The main value I want to extract is to be able to see what was the plan vs what actually happened. And if I can make what actually happens closer to the plan - this is WIN.
But capturing what you are thinking of, what you are working on etc. - quite challenging and often happens offline, on the phone, another computer, messenger, email etc.
My quick take: companies were closing their data for decades and now it will bite them in their back - AI needs as full of a context as possible across devices, services and programs, to make AI as powerful as it can be and current architecture works against it. May be one day AI is so powerful that it will ETL all this data for itself, but for now it is painful to try to build something like this.