Marco Massenzio

A really nice read from Sai Maddali on the benefits of Tiered Storage with Amazon MSK. https://lnkd.in/gGNJ5nyt #ApacheKafka #Kafka #AWS #MSK #tieredstorage #streaming #storage

55

2 Comments

Thats the exact explanation I gave to a group of investors last week. (… it’s just Precision/Recall, attributes vectorization as “embedding”, K-Nearest Neighbor, User Search Intent, DAG, ML algorithms, etc all over again …). LOL and they asked what’s new this time around. And I was like not much, ML is still the backbone, and AI is the inference and actions based on the model. It works better when there is a feedback loop in a closed system. But the current state of the art like ChatGPT is based on scraping the Internet (garbage in, garbage out). Kinda like early search engines. What is a better analogy is that NVIDIA/Snowflake etc are selling tools, aka pickaxes to prospectors. The gold is up to you to find. And the opportunity right now is to monetize industry specific (healthcare, travel, financial services) clean data to build models with (aka a treasure map for the prospectors). From an enterprise perspective, what’s out there today aka generative AI isn’t very useful. Too much hype. To build useful engines will require an effort similar to search revolution 2 decades ago. From

16

3 Comments

We’re excited to announce vector search on both the new Memorystore for Valkey and Memorystore for Redis Cluster, combining 1) ultra-low latency in-memory vector search, with 2) zero-downtime scalability (in or out), and 3) powerful high performance vector search across millions or billions of vectors. #databases #valkey #redis Google Cloud

462

7 Comments

When working with Amazon MSK, developers are interested in accessing the service locally. This allows developers to test their application with a Kafka cluster that has the same configuration as production and provides an identical infrastructure to the actual environment without needing to run Kafka locally. This post presents a practical approach to accessing your Amazon MSK environment for development purposes through a bastion host using a Secure Shell (SSH) tunnel (a commonly used secure connection method). Whether you’re working with Amazon MSK Serverless, where public access is unavailable, or with provisioned MSK clusters that are intentionally kept private, this post guides you through the steps to establish a secure connection and seamlessly integrate your local development environment with your MSK resources. https://lnkd.in/g4yiF3yH #MSK #serverless #ApacheKafka #testing

30

With the announcement of S3-native-streams (Freight clusters), here is a commentary on Confluent strategy regarding object storage, streaming and an open data architecture. https://lnkd.in/dTg6DKVy

49

6 Comments

The best part about the new Llama 3.1 family of models is that you can fine tune them on AWS Trainium chips. These are more energy and cost efficient chips and with great performance purpose built for the training and fine tuning tasks. #aws #Llama3.1 #sagemakerjumpstart https://lnkd.in/d6S5Gdae

25

1 Comment

Google Cloud Vertex AI is rolling out multiple updates to make AI accessible for every enterprise. Up to 85% lower input costs and 80% lower output costs, and 100+ new languages coming to Gemini 1.5. #GoogleCloud #VertexAI #Gemini

3

I'm really excited to share this new blog on Amazon's Exabyte-Scale migration from #Spark to #Ray! 🐘 1.5EiB of data processed in a quarter 🚀 82% better cost efficiency 💸 $120M saving per year OK you might ask: isn't #BigData processing Apache Spark's bread and butter? 🤔 Well, this is a story about software abstractions.. Like Patrick Ames wrote in the blog, "... (Amazon engineers) had limited options to resolve performance issues due to Apache Spark successfully (and unfortunately in this case) abstracting away most of the low-level data processing details". So, the takeaway: if you need more flexibility in data processing (e.g. need GPU, or #unstructured data like video), let's talk! https://lnkd.in/gesSyxHF to get started https://lnkd.in/gfj2Xp_2

205

5 Comments

Redis Cloud is now available in Saudi Arabia on Google Cloud! This marks a major milestone in our journey to deliver a seamless, scalable cloud experience globally. With Redis Cloud on Google Cloud, developers in Saudi Arabia can now build and deploy applications at a global scale while meeting local requirements, all while reducing infrastructure costs and maintenance. Read the full article to discover the benefits and learn how this can boost your business! #RedisCloud #GoogleCloud Redis Google Cloud

2

1 Comment

Hear from Sachin Gupta, VP and GM, Infrastructure and Solution Group, Google Cloud to learn customer-proven strategies for AI-powered innovation and modernization, leveraging the best of public cloud, edge, sovereign, and cross-cloud infrastructure and services. See how leaders are achieving real business outcomes faster and more cost-effectively in industries like retail, healthcare, and even the most stringent regulated industries. Plus, see how Gemini is dramatically simplifying and reimagining cloud as we know it.

1

1 Comment

Pleased to share that Amazon Elastic Kubernetes Service (EKS) support in Amazon SageMaker HyperPod is available today for customers. SageMaker HyperPod has become a go-to solution for AI startups and enterprises to efficiently train and deploy large scale models. With today’s launch, organizations can reduce training time by up to 40% and strengthen resilience through deep health checks, automated node recovery, and job auto-resume capabilities. Here’s a great guide on how your team can get started with Amazon EKS support in Amazon SageMaker HyperPod.  https://lnkd.in/g8xj9RAi

179

2 Comments

Great insights about making single-agent system powerful. Has good ml system implications as well. Prompt prefix caching would become one key technique here that interplays with other general inference optimization techniques

24

According to Gartner® “Infrastructure and Operations (I&O) teams commonly struggle to manage Kubernetes (K8s) clusters at scale due to the talent shortage 🤼 — especially on heterogeneous scenarios (multicluster, hybrid, edge, etc.) or supporting multiple downstream teams. Besides inherent Kubernetes complexities, K8s teams must cope with the increase in the average number of clusters per organization from a few to dozens. As the cluster count grows and spans, the stack becomes more complex and diverse across different infrastructures (cloud, on-premises, and edge). This negatively impacts practitioners’ ability to maintain the clusters and demands more attention from I&O teams." 👉 struggling with managing complex Kubernetes? 🗓 schedule free consultancy => https://lnkd.in/dyErkV_C #angelscloud, #k8s, #Kubernetes, #digitaltransformation #multicluster #cloud

3

"In summary, the Fermyon Technologies for #Kubernetes represents a significant advancement in cloud native computing. By enabling higher density and lower cost, while maintaining ease of use, security, and open standards, SpinKube positions itself as a key player in the future of Kubernetes application deployment. Here it is important to mention that Fermyon donated SpinKube to the CNCF sandbox." Great article by Torsten Volk on the nexus of #AI and #Wasm https://lnkd.in/g_fxZKMc

23

Well done #AWS for promptly fixing an S3 billing edge-case! Interesting S3 cost issue in this blog: "How an empty S3 bucket can make your AWS bill explode". In brief: external unauthorised (denied) requests to a new empty S3 bucket were being charged - $1,300 within two days. The author had inadvertently chosen the same bucket name that was the placeholder default configuration in a popular open-source tool!    https://lnkd.in/eNEqedR8 That blog was published on 29th April 2024. On 13th May, AWS fixed this problem: "Amazon S3 will no longer charge for several HTTP error codes". https://lnkd.in/eMXuhhu8 To quote that announcement: "bucket owners will never incur request or bandwidth charges for requests that return an HTTP 403 (Access Denied) error response if initiated from outside their individual AWS account or AWS Organization."

6