Q26 — AWS SAA-C03 Ch.12

Question 26 of 100 | ← Chapter 12

Q826. A company has stored 10 TB of log files in Apache Parquet format in an Amazon S3 bucket. The company occasionally needs to use SQL to analyze the log files.Which solution will meet these requirements MOST cost-effectively?

Correct Answer: C. Create an AWS Glue crawler to store and retrieve table metadata from the S3 bucket. Use Amazon Athena to run SQL statements directly on the data in the S3 bucket.

Explanation

The solution that will meet the requirements most cost-effectively is option C: Create an AWS Glue crawler to store and retrieve table metadata from the S3 bucket. Use Amazon Athena to run SQL statements directly on the data in the S3 bucket.Amazon Athena is a serverless query service that allows you to run SQL statements directly on data stored in Amazon S3. It is specifically designed for analyzing data in S3 without the need for infrastructure management. With Athena, you can query the log files in Apache Parquet format directly, without the need for any data migration or additional services.By using an AWS Glue crawler, you can automatically discover and catalog the log files in the S3 bucket. The crawler will store and retrieve the table metadata, making it easy to query the log files using SQL statements in Athena.Option A suggests creating an Amazon Aurora MySQL database and migrating the data from the S3 bucket using AWS Database Migration Service (DMS). This option involves additional infrastructure and data migration, which may not be cost-effective for the given requirements.Option B suggests creating an Amazon Redshift cluster and using Redshift Spectrum to run SQL statements directly on the data in the S3 bucket. While Redshift is a powerful data warehousing solution, it may be more expensive than using Athena for occasional SQL analysis due to the cost of maintaining a Redshift cluster.Option D suggests creating an Amazon EMR cluster and using Apache Spark SQL to run SQL statements directly on the data in the S3 bucket. EMR is a fully managed big data processing service, but it requires more management overhead and may not be as cost-effective as Athena for occasional SQL analysis.Therefore, option C is the most cost-effective solution as it leverages AWS Glue and Amazon Athena to directly query the log files in S3 without the need for additional infrastructure or data migration.