How Much Does It Cost to Self-Host Open Models on AWS?
Your AI bill tripled last quarter and your CTO is asking about open models. Here’s the real hardware, real costs, and whether it makes sense for a team of 10 or a company of 500.
Tag
Your AI bill tripled last quarter and your CTO is asking about open models. Here’s the real hardware, real costs, and whether it makes sense for a team of 10 or a company of 500.
Now that I have got your attention with a catchy title - let me share with some of my thoughts regarding how AWS shines and how much your experience as a customer matters. Deploying instances in the …
Many of us working with any cloud provider know that you should never ever commit access keys to a public github repo. Some really bad things can happen if you do. AWS (and I assume all the cloud …
I have a decent commute every day back and forth to work and I have come to enjoy listening to a number of podcasts throughout the week. I will try and keep the list up to date - here As of today - …
Back in July 2018, I started to write a blog post about the upcoming death of Docker as a company (and also perhaps as a technology) but I never got round to completing and publishing the post. It is …
I have come across this a number of times of the past couple of months. Environments that were born in the datacenter, have grown in the datacenter - in short people who are used to certain (shall we …
I don’t always do these kind of posts but 2018 was a substantial year for me that warrants a short summary. I released the AWS Powershell Container - gauging by the number of pulls - I guess …
So after leaking (or not really leaking) from some of the sessions from re:Invent it seems that AWS have finally released the Client VPN AWS Client VPN is a managed client-based VPN service that …
I called it - to me it was obvious that this was going to happen. The signs were all there. This was the direction that the market has been pushing for, and AWS has a reputation of giving the …
A customer came to me with a request. They do not want to use a NAT gateway from their VPC to access the AWS API’s. They had a number of security concerns regarding the use of a NAT gateway (no …