This happens everywhere. The devil is in details. If we use an application and the surface we see looks simple, we assume it must be simple to build :) Then we start to see all the complexity behind.
Shameless plug: This kind of posts was the reason I wrote about it recently too [1]
Adevinta | Barcelona, Spain or Remote (GMT +- 4h) | Full time
Site Reliability Engineer @ Common Platform Runtime (CPR) | 40.000-70.000€/year + bonus and other perks | We offer relocation and visa, if needed.
CPR operates a managed multi-cluster, multi-tenant Kubernetes runtime. We run thousands of containers for teams across Adevinta.
We think that running containers in a K8s cluster isn’t cool. Do you know what’s cool? Running them in multiple clusters and being able to resist cluster failure.
Do you want to know more about how we do it? Let’s talk [1]
---
Adevinta [2] began its journey as a standalone company in 2019, as a global online classifieds specialist, operating digital marketplaces in 11 countries. We provide technology-based services to connect buyers with sellers and to facilitate transactions, from job offers to real estate, cars, consumer goods and more.
Our portfolio includes more than 30 digital products and websites, attracting 1.3 billion average monthly visits.
During 2020, Adevinta agreed to buy eBay Classifieds Group [3] to become the largest pure-play online classifieds company in the world.
Comparing only instance prices is not fair, imho. Amazon charges that because all of the services/ecosystem they have. Google Cloud is stepping up their game though, leading to cheaper prices in AWS.
Amazon has a very broad offering of great fully managed services, but Google's no slouch. In fact, many of Google's offerings can be very compelling - BigQuery, Bigtable, CloudML, PubSub, GKE to name a few.
Just in the "only instances" space you mention Google has a different strategy. A couple things to mention:
- Google doesn't have a broad spectrum of instance types. No storage-optimized or networking optimized. Instead, any instance can just get great storage attached to it, and any instance gets best-in-class networking.
- Google's Preemptible VMs are like Spot instances but fixed 75-80% off. Again, with less fragmentation against instance types + fixed cost, much easier to rely on Preemptible VMs imo.
- Google's Load Balancer is global, scalable, anycast IP driven, and backed by Google Network. If your packets originate in, say, New Zealand, they'll be talking to a "GCLB instance in our pop in Sydney", which will carry packets on Google's backbone to the VMs.
- Custom VM sizes - you can set your own VM/RAM combination for instances.
- Live Migration. Google manages instance health and maintenance for you, without forcing restarts.
(Work at Google but not on GCE.. and I don't get paid to post here)
I'm not sure I'd agree that Google has a broad spectrum of instance types. You can boost up individual components, but for example if I wanted an EC2 instance with as much local SSD space as I can get I could have 6.4 terabytes, while on GCE I could have 3 TB. If I want memory, Google's willing to give me 200GB, Amazon offers 10x as much.
My impression is that Google has a first class general purpose instance but you don't really get the breadth of options that EC2 will give you.
You bring up a good point. Amazon does give you a better "vertical scaling" story. I'll still challenge you on the "breadth" when it comes to EC2 - the philosophy is just very different. Why do you need a "IO optimized instance" if you want just fast disk - that notion just seems very foreign and arbitrarily-constrained on Google Cloud.
You bring up Local SSD. Google's Local SSD is just badass by comparison:
- 680,000 Read and 360,000 Write IOPS included in the cost [0]
- $0.218 per GB per month. Instance cost is separate.
- Again, you can attach these to any instance type (hence the point on fragmentation of instances on EC2)
- AWS goes up to 365,000 Read and 315,000 "First Write" IOPS. Only if you buy an i2.8xlarge [2]
The real problem I have is the low network performance. Yes, yes, before everyone jumps all over me and points to Jupiter etc.. I understand the problems in Pb/s bisection bandwidth for the large datacenters. That doesn't change the fact that I don't need an entire datacenter worth of stuff.. but I do need an Amdahl-balanced cluster. So big machines with wimpy (20Gb non-RDMA) networks prevent me doing my HPCish workloads on GCE.
Followed by waiting on GPUs and other user accessible accelerators of course.
AWS spot instances are a fraction of the price, like 20-30%. In my experience, building the same processing cluster from AWS costs half as much as Google Cloud.
Which is why I find it so annoying when I see these price comparison articles that don't really use the SpotFleet API correctly.
Agreed. The value of AWS is not in the cost of the instances it is the services and customer service which go along with it. Its all of the easy manages services that add up. Its the combination of RDS, SQS, and all of the other features that add up. Sure each EC2 instance may be more expensive, but there are huge savings in time (which is more valuable) elsewhere.
This "X shaming" or "X gender inappropriate joke" is really getting out of hand. You can't say anything anymore. You may hurt someone's feelings, bla bla bla. I'm sick of this. I'm sick of this political correctness that is intoxicating our society. You cannot say anymore: "hey, grow a pair!" because this is sexist? Come on... this is insane! One thing is to respect everybody and another one is to apply censorship to everything. Even though people didn't meant to offend, harass or shame other people.
> Even though people didn't meant to offend, harass or shame other people.
That's the thing - people who shame others are not looking at intent behind actions; they're getting offended by shallow interpretations (a sign of insecurity). Any reasonable person looking at Crockford making his "weak" joke would not think his intention was to harass physically weak people.
This kind of shit is also why you see people like /r/the_donald aggressively provoking and fighting back against these so-called "SJW's" - the pendulum has swung way too far the opposite way.
When I met Gitlab, 3 years ago, I didn't expect this. The product is so much mature, the UI is so much better and the feature-set increased too. I respect these guys. The competition is though out there. Github is _the_ place where many git users started and is the _de facto_ standard for open-source/show-cases or even tech blogging, these days.
There are a few things that annoy me as a Gitlab user (UX things), apart from the search/responsiveness of the application. Moreover, they improved _a lot_ the installation/upgrade process over these years. I'm expecting big things from you now :)
Anyway I need to say that these guys have been working a lot and deserve much credit. Kudos for you, guys!
One of the things that annoys me most is that the homepage of the repository, where you have the README is not the same where you have a file browser (Perhaps this is Github-biased, but is soooooo much better. Think about it :)
The only thing preventing me from using Gitlab is that someone registered my username. I'm "echelon" on Github, Twitter, Gmail, and dozens of other services. I guess I missed the boat. :/
Thanks! We think the displaying both project information and the files is too messy, but I can see you point. If you have any other UX suggestions feel free to share them.
Shameless plug: This kind of posts was the reason I wrote about it recently too [1]
1 - https://world.hey.com/joaoqalves/i-could-build-this-during-t...