I'm prone to nostalgia and love projects like this. It's a very unique feeling that's hard to describe. I wonder why we feel these things for the past we've experienced.
Because it’s the closest thing to proof that people truly do live entirely different realities. Whoever you were staring at those shows at that age is simple not you now and can never be you again. It’s almost supernatural. If you follow this line of thinking, it’s possible to live entirely different existences, almost in another body (you can take that however far you want, reincarnation, life after death, being unplugged from the simulation, etc).
It’s a mystical way of asking “what exactly was the past really and how transient am I now at this exact moment?”.
I like and use HyperDX in production and like it a lot. So kudos to the team for building and merging with Clickhouse. I found a lot of monetary value switching over to HyperDX considering it's significantly more cost efficient for our needs.
Should we be starting to prepare for the original HyperDX product to be deprecated and potentially move over to ClickStack?
First off, always really excited to hear from our production users - glad to hear you're getting good value out of the platform!
HyperDX isn't being deprecated, you can probably see on the marketing page it's still really prominently featured as an integral part of the stack - so nothing changing there.
We do of course want to get users onto HyperDX v2 and the overall ClickStack pattern. This doesn't mean HyperDX is going away by any means - just that HyperDX is focused a lot more on the end-user experience, and we get to leverage the flexibility, learnings and performance of a more exposed ClickHouse-powered core which is the intent of ClickStack. On the engineering side, we're working on making sure it's a smooth path for both open source and cloud.
side note: weird I thought I replied to this one already but I've been dealing with spotty wifi today :)
This is good feedback to make things more clear :) HyperDX is part of ClickStack, so ClickStack = { HyperDX, ClickHouse, OTel }. This is the stack we recommend that will deploy in seconds and _just work_, and can scale up to PB+ and beyond as well with some additional effort (more than a few seconds unfortunately, but one day...)
HyperDX v2, the version that is now stable and shipped in ClickStack, focuses more on the querying layer. It lets users have more customization around ClickHouse (virtually any schema, any deployment).
Optionally, users can leverage other ways of getting data into ClickHouse like Vector, S3, etc. but still use HyperDX v2 on top. Previously in HyperDX v1 you _had_ to use OTel and our ingestion pipeline and our schemas. This is no longer true in v2.
What's your opinion on OTel when trying to keep things small and performant? I've got some experience working with OTel the last few years, and I'm a bit afraid of the expanding scope and complexity compared to "simpler", more targeted solutions, like for instance Vector.
I'm just asking because you mention OTel and "other ways" in your post, and you must have a good overview over the options and where the market is headed.
It's actually not clear to me that Vector is any simpler than OTel imo (VRL is way more complicated than OTTL for instance). You can also use otel collector builder (ocb) to build a slimmed binary.
My take is that OTel is overall the best investment, it's widely supported across the board by many companies and other vendors. It's also constantly being improved with interesting ideas like otel-arrow which will make it even more performant (and columnar friendly!)
We'll also continue invest in the OTel ecosystem ourselves in making it easier and easier to get started :)
That being said, I'm not saying that OTel collector is always the right choice, we want to meet users where they are. Some users have data that gets piped into S3 files and we ingest off of a S3 bucket just due to how they've collected data, some use Vector due to its flexibility with VRL, focus on logs, or specific integrations it provides out of the box. So the answer is always - it depends :) but I do like OTel and think the future is bright.
I'm also a bit confused. I'm using HyperDX cloud and sending telemetry directly from NextJS. What's the benefit of using ClickStack compared to HyperDX cloud?
ClickStack is currently just open source - so there's no cloud or a fully hosted offering yet! (Of course you can always pair ClickStack with ClickHouse Cloud to have your ClickHouse hosted for you).
But in this case there's probably no reason for you :) These improvements will come to our cloud offering of course as we work on rolling out upgrades from HyperDX v1 to v2 in cloud.
I think it's interesting that they note they have hundreds of customers but their home page says it's trusted by thousands of companies. Are all these companies on a free tier?
I would imagine it's the usual SaaS marketing embellishment, e.g. one Google employee used the software on a trial at some point === "Trusted by Google"
I feel this is positive news moving in a positive direction. Do you suggest not doing anything to improve the situation? We can’t go back in time. But we can help ourselves in the future.
One way to help yourselves in the future would be to learn the meta-lesson that actually things that work in other countries mostly work the same way in the US too.
Yes this whole thread is so depressing. Most commenters here are talking as if electric trains were an oddity. It's like listening to people questioning the benefit of running water over the old school walk to the well.
I'm all for positive change too. But as someone who isn't delusional, I have to account for practicality rather then dreaming about an unrealistic future.
I believe early grade schools should be relatively broad in the subjects they teach. Not every child will be interested in math or science. And there's nothing wrong with that. I feel many parents don't agree, especially those from a technical background. A healthy society should have a diverse set of skills across many disciplines. Though I do believe if children are interested in furthering their study on a particular subject (not just math), there should ideally be opportunities from schools.
It’s shameful to not be interested in math and science—that’s like saying you’re not interested in reading. But putting that aside, the other subjects should be educational.
I remember what triggered my mom was us spending an inordinate amount of time making clay models of Native American villages. American kids shouldn’t graduate high school knowing more about the shapes of Native American houses than the conceptual underpinnings and history of their own civilization.
I believe there's value in learning about such topics such us how historical village buildings are created from a child's perspective. Regardless whether it's Native American, European, or African, etc. It allows us to reflect on what was built before and to understand what to avoid or improve in future development. Not to teach them the exact technical details, but to light a spark to those children inclined. We need people who are interested in such things to study it so future generations can understand where we have come from and how far we have gone. I believe it also allows us to appreciate that there are many peoples and countries today that still live this way and allow us to be empathetic or humbled by their way of living.
I believe math and science should be invested in but if I had a choice between a broad learning curriculum and a focused one, ill choose broad.
If you've ever watched a movie or listened to music, you'll be surprised to know not all of the artists are well versed in math or science. You may be surprised that many of the people, experiences, entertainment, and sports you absorb may not be math inclined either. I personally find value in that.
Because people live in a world that is understandable through math and science. They don't need to specialize in those subjects, but as a human in reality they should familiarize themselves with reality.
Shortboxed Inc. | https://shortboxed.com | San Francisco, CA / Remote | Senior Backend Software Engineer | Full-time
Shortboxed is a mobile marketplace for buying and selling collectibles - comic books, video games, trading card games, sports cards and more. We’re looking to hire our a full-time engineer to design and build upon our existing application, and you’ll play an important role in building the company as we continue to grow. The position will initially focus on backend with a possibility to work on the full stack.
What you'll be working on: Several backend APIs including, but not limited to, deep personalization using ML and AI, collectibles databases, collection management applications.
Our stack: PHP, React Native, NodeJS and some Python on AWS
Requirements:
- 4+ years of backend development experience using PHP
- Experience with production AWS
- Extensive experience with SQL
- Nodejs (nice to have)
- React Native/React for mobile and web development (nice to have)
If you're looking to disrupt a fun and exciting industry that hasn't evolved in decades, give us a shout at bj@shortboxed.com with “HN” in the subject. Bonus: tell us who your favorite superhero is and why!
