Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Hadoop very "fancy" 5-6 years ago, what's the trend now? I guess with managed services from AWS / Google it makes Hadoop less useful?


Its still there - storage is still mainly HDFS, but computation layer morphed into Spark on Yarn (Mesos as a scheduler is barely used). Barely anyone runs classic Mapreduce jobs, Spark all around, written in Scala(or java or python).


The managed data science services from AWS/Google is Hadoop/Spark.


True. Some one in the cloud is managing these Hadoop stacks for you. You just pay usage of these services.




Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: