| Description: |
AWS Developer
Location Toronto
Staffmax is looking for AWS Developer for our client. This a permanent opportunity with many benefits and attractive compensation. Apply today
Must have skills:
- Candidate should have strong working experience with data services (EMR, S3, Hive) on AWS cloud
- Strong hands-on experience on AWS EMR (Spark with Scala) and AWS S3
- Strong hands on experience in Hadoop services like Hive and Spark
- In-depth knowledge and extensive experience in building batch workloads on AWS using AWS EMR
- Adept in analyzing and refining requirements, consumption query patterns and choosing the right technology fit like RDBMS, data lake and data warehouse
- Should have knowledge of analytical data modelling on any of the RDBMS platform / Hive
- Proven practical experience in migrating Hadoop based data lake from on-prem to AWS EMR on EMRFS
Good to have skills:
- Hands-on experience working with Terra bytes \ peta bytes scale data and millions of transactions per day
- Skills to develop ETL pipeline using Airflow
- Knowledge of Spark streaming or any other streaming jobs
- Ability to deploy code using AWS Code Pipeline and Bit bucket is an added plus
- Expert in any of the following programming language: Scala, Java and comfortable with working on Linux platform
- Knowledge of Python
Key responsibilities:
- Understand requirement from product owners and translate into requirement and scope documents
- Decide on the best fitment of technologies/services that are available in scope
- Create Solution for data ingestion and data transformation using Hadoop services like Spark, Spark streaming, Hive, etc.
- Create technical design documents to communicate solutions to the team and mentor the team to develop the solution
- Build the solution with AWS and Hadoop Services as per design specifications
- Assist team teams to build test cases and support with testing the solution
- Coordinate with Upstream, Downstream and other supporting teams for production implementation
- Provide post-production support for Solutions implemented
|
