The company is a fast-growth provider of an AI-powered software platform in the media space. It was founded in 2015 and has offices across the US.
AI, Computer Software, Media
Optimize data analytics costs without sacrificing performance.
Amazon Athena, Amazon Simple Storage Service (Amazon S3), AWS Glue, Amazon Kinesis, nOps
72% monthly cost savings.
Fast data ETL.
Better consumability and customization of AI-powered data.
An AWS Well-Architected Review revealed to the company that data analytics running on the Cloudera platform was driving high costs. While they were satisfied with the performance of the Cloudera platform, they wanted to reduce their data analytics costs without sacrificing performance.
The company turned to nClouds, a Premier Consulting Partner and Well-Architected Partner in the AWS Partner Network, to collaborate on an AWS Well-Architected Review based on a set of architectural best practices for reviewing critical workloads running on Amazon Web Services (AWS). The Review revealed opportunities for infrastructure improvement, including cost optimization, security, operational excellence, and reliability.
After the Review, based on nClouds’ AWS technical expertise in data and analytics, the company asked nClouds to help them optimize costs by migrating from the Cloudera platform to an AWS architecture featuring AWS managed services for data analytics with pay-as-you-go pricing.
And, the company asked nClouds to partner with them to enhance security. They implemented security best practices such as enabling MFA on the root; implementing life cycle, MFA, and password policies for all users; disabling or removing all inactive keys; restricting public access to virtual private cloud (VPC) resources; checking for Identity and Access Management (IAM) policies attached to users; and monitoring resources for encryption at rest.
The company engaged with nClouds to help them optimize their data analytics costs by migrating from the Cloudera platform to an AWS infrastructure featuring AWS Glue, Amazon Athena, and Amazon S3.
AWS Glue ETL service prepares and loads the company’s data for analytics. It structures different formats of datasets in a standard way and puts a metadata layer on top of it (the AWS Glue metadata catalog) so that all data can be accessed in the same way. As a managed service, there are no resources to manage, no upfront costs, and there’s no charge for startup or shutdown time.
Once the data is in the AWS Glue metadata catalog, it is sent to Amazon Athena, which provides significant cost savings and performance gains by compressing, partitioning, or converting data to reduce the amount of data that Athena must scan to execute a query.
The company can create policies to move less-frequently-accessed Amazon S3 data to cheaper storage tiers for considerable savings. And, there is no charge for transferring data between Amazon S3 storage options if they are within the same AWS Region. With Amazon S3 Select they can retrieve a subset of data from an object using simple SQL expressions, driving cost savings, and improving performance by up to 400%.1
Teaming with AI Innovator, nClouds migrated data analytics from Cloudera to AWS. The project has yielded numerous benefits:
With AWS Glue, the company pays only for the time their ETL job takes to run. Amazon Athena charges the company only for the queries that they run based on the amount of data scanned by each query. Amazon S3 saves storage costs via S3 Intelligent-Tiering, and data access costs are reduced (by as much as 80%) by using Amazon S3 Select.
Using AWS Glue, the company’s data is immediately searchable, queryable, and available for ETL. It automates much of the effort in building, maintaining, and running ETL jobs. AWS Glue is serverless, so there is no infrastructure to provision or manage.
AWS Glue takes datasets in different formats and converts them into a single, query-optimized format that can be easily consumed by various analytical tools.
1Amazon Web Services, Inc. (2018). Amazon S3 Select Is Now Generally Available. https://aws.amazon.com/about-aws/whats-new/2018/04/amazon-s3-select-is-now-generally-available/
You can also email us directly at email@example.com for your inquiries or use the form below