Job Description
We are seeking an AWS Data Engineer with a strong foundation in AWS services and data ingestion using APIs. This individual will be instrumental in architecting and building scalable data solutions, leveraging AWS technologies such as S3, Redshift, Glue, and EC2 to support our data infrastructure needs.
Key Responsibilities:
Strong communication skills for effective collaboration and documentation.
Develop and maintain scalable and reliable data pipelines to ingest data from various APIs into the AWS ecosystem.
Manage data storage solutions using S3 buckets, ensuring best practices in data organization and security.
Utilize AWS Redshift for data warehousing tasks, optimizing data retrieval and query performance.
Configure and use AWS Glue for ETL processes, ensuring data is clean, well-structured, and ready for analysis.
Utilize EC2 instances for custom applications and services that require compute capacity.
Implement data lake and warehousing strategies to support analytics and business intelligence initiatives.
Collaborate with cross-functional teams to understand data needs and deliver solutions that align with business goals.
Ensure compliance with data governance and security policies.
Mandatory Skills:
Solid experience in AWS services, especially S3, Redshift, Glue, and EC2.
Proficiency in data ingestion and integration, particularly with APIs.
Strong understanding of data warehousing, ETL processes, and cloud data storage.
Experience with scripting languages such as Python for automation and data manipulation.
Familiarity with infrastructure as code tools for managing AWS resources.
Excellent problem-solving skills and ability to work in a dynamic environment.