Data Engineer | Big Data  

• Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties

• Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.

• Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.

• Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala.

• Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.

• Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.

• Required Technical and Professional Expertise
• . Development experience in Big Data software development technologies such as Hadoop, Hive or Spark.
• 2. Proficient background in Unix or Linux programming language.
• 3. Good understanding in SQL and RDBMS. Good at modeling data for relational, analytical and big data workload.
• 4. Strong problem solving, analytical, design, decision-making and communication skills.
• 5. Self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities.
• 6. Provide support for deployed data applications and other data consumers by identifying data problems and guiding issue resolution with partner Data Engineers and source data providers
• Must Have skill in Big Data tools such as Hadoop, Hive or Spark
  Proven background in SQL, Unix/Linux and ETL process
  Preferably with knowledge in MicroSoft Azure Databricks
  Nice to have skills in DevOps, Jira, Jenkins or Git