The last kiwix zim dump of English Wikipedia before the release of ChatGPT is from May 2022. The Internet Archive still preserves the torrent[0]. To host this, or browse it locally you can use `kiwix-serve -p 8888 wikipedia_en_all_maxi_2022-05.zim` from kiwix-tools[1].
There are likely a number of beneficial bots[0] running from cloud providers. And residential proxies are also widely available for very determined scrapers.
I spent a large chunk of 2024 reading _The Power Broker_ and all the Lyndon Johnson volumes. Caro recreates the entire world of every story in those books in so much detail that every biography or historical book I've read since has felt thin. I'm desperate for the fifth volume of the Johnson biography—I have no idea how he'll pull off such a sweeping final chapter, but I cannot wait to find out.
1. This is a familiar problem and it is where I spend the majority of time. If a bank provides a unique transaction ID the it would be a simple matter of code; however, none of mine do. What I do when I spot problems is run `hledger areg <account> --begin=<last month> --end=<this month>` and compare with the CSV. Opening the output of that command + this months CSV in vim using vertical split (`vsp`) and scrollbind (`scrollbind`) so each line scrolls together works well and is pretty quick. It's still a problem and a pain.
2. This is solved in my system in a robust way (I believe) with a "virtual account." I do most of my spending on my credit card. Then every month I pay off the card from my checking. To represent this I need to see:
- liabilities:credit with any balance I carry
- expenses should show a transfer from liabilities:credit to the correct expense category/account
- I should avoid being "double charged"; i.e., when I pay off liabilities:credit it should NOT be an expense.
I've set it up like this:
- rules/debit/journal.rules: if (payment to credit) then account2 assets:transfer:credit
- rules/credit/journal.rules: if (payment from debit) then account2 assets:transfer:credit
This becomes a way to spot problems. If assets:transfer:credit ever has a balance then something may be awry and you should spend some time digging. I do the same thing for Amazon. Each Amazon order is for multiple expenses. I have assets:transfer:amazon. This is how I learned the the $0.29 Colorado retail delivery fee is not universally applied to orders from Amazon—that was a frustrating journey!
3. I haven't worried about this. Looks like other good responses in this thread.
> 1. This is a familiar problem and it is where I spend the majority of time. If a bank provides a unique transaction ID the it would be a simple matter of code; however, none of mine do.
This is an annoying problem I've had to deal with also (banks have some unique ID somewhere, why not provide it?).
I create my own unique ID to the extent that it's possible. Some txns have the exact same info but are 2 sep txns, requires a bit of messy logic.
I've been reading Caro's multi-volume biography of Lyndon Johnson. This was the best book I've read at overcoming my initial expectations (Johnson is a hugely flawed human being, wowza).
I have a Davis Vantage Vue. It's a nice station, but requires a proprietary data logger to get a serial connection which I loathe. There's tons of good weather station nerd info on wxforums[0].
weewx[1] software supports sending data to CWOP and has drivers for the Davis station among others.
Bonus: you can also send data to CWOP over the ham bands via aprs, and all your data shows up on aprs.fi[2]
I have a Vantage Pro2 with the WeatherLink Live. I'm really happy with it. It has a pretty simple API you can hit on the local network, and it can push to weatherlink.com. It's a bit on the pricey side, but I live in a fairly rural area, so it's nice to have my own data. Plus, I'm on a private airstrip, so other pilots can use see it.
It's been a while, but with a little bit of solder and a slightly-janky connector, you don't need the proprietary dongle to connect to a serial connection (at least with a Vantage Vue from ~2010).
The Vantage Vue hardware is solid; much better than the cheaper kits out there.
I spent some time building a data logger when I first got my vue, but they updated hardware circa 2012 specifically to thwart this, it seems[0]. It was a frustrating discovery: had to spend an extra $100 for something that can be made with $2 worth of parts :(
[0]: <https://web.archive.org/web/20221007114937/https://download....>
[1]: <https://github.com/kiwix/kiwix-tools>