Data Engineer

BANGALORE

Job Description: Data Engineer

Company: Tata Digital Limited

Experience Level: 5 – 8 yrs

Location: Mumbai/ Bangalore

 

Functional / Technical Skills 

  • Big data development experience – Kafka, Hadoop
  • Experience building data pipelines using Spark and/or Hive
  • Strong knowledge in R/Python/Rubys
  • Advanced proficiency in Java/Scala, SQL, NoSQL
  • strong in Database and Data Warehousing concepts
  • Expertise in SQL, SQL tuning, schema design, Python and ETL processes
  • Experience with Cloud Technologies ( GCP, AWS)
  • Highly Motivated, Self-starter and quick learner
  • Proficiency in Statistical procedures, Experiments and Machine Learning techniques
  • Must have knowledge on basics of data analytics and data modelling
  • Excellent written and verbal communication skills 

Roles/Responsibilities

  • Active involvement in building of recommendation engine
  • Design new processes and builds large, complex data sets
  • Conducts statistical modeling and experiment design
  • Tests and validates predictive models
  • Build web prototypes and performs data visualization
  • Generate algorithms and create computer models
  • Should possess excellent analytical skills and troubleshooting ideas
  • Should be aware for Agile Mode of operations and should have been part of scrum teams
  • Should be open to work in Devops model with responsibilities of Dev and Support both as application goes live
  • Should be able to work in shifts (if required)
  • Should be open to work in fast paced, project with multiple stakeholders