This site uses cookies. To find out more, see our Cookies Policy

Sr. Data Engineer in Durham, NC at ettain group

Date Posted: 11/29/2018

Job Snapshot

  • Employee Type:
    Full-Time
  • Location:
    Durham, NC
  • Job Type:
  • Experience:
    Not Specified
  • Date Posted:
    11/29/2018

Job Description

Durham, NC -

Job Title:  Sr. Data Engineer

Location:  Durham, NC 

Industry:  Mobile 

Terms:  Contract-to-Hire 

Compensation:  $110-120K

Requirements:   hadoop, AWS, Java

Sr. Data Engineer Job Responsibilities:

  • Collaborate with cross-functional teams to conceptualize, build, test and ship Big Data solutions that meet business and market needs.
  • Take a leading role in designing and leading the implementation of company wide data architecture strategy
  • Create and maintain systems that load and transform large data sets from various internal sources.
  • Act as subject matter expert for Data technologies like Redshift, Spark, MySQL, Vertica, Aerospike and Vertica.
  • Design and maintain data model for new and existing production systems. Use tools such as Flyway and Confluent to maintain data schema versioning.
  • Developing and supporting backend components that manage live streaming of data
  • Work with our Data Scientist and Business Intelligence team to create data-driven insights and reports for senior management.
  • Perform daily monitoring, administration, repair and maintenance related to data technologies and related technologies in all environments.

Sr. Data Engineer Job Requirements:

  • Bachelor’s Degree or equivalent work experience
  • Minimum 5 years of R&D experience working with production systems which support high volumes of data traffic
  • Experience designing and supporting ETL solutions to support business requirements such as reporting, dashboards and data analytics
  • Highly proficient in open source SQL systems, particularly Spark SQL, Redshift, MySql
  • Proficiency in multiple programming languages, including Java, Scala, Python and Ruby
  • Demonstrable experience with cloud-based Services. Particularly AWS tools such as RDS, Glue, data pipelines, EMR and Labmda.
  • Expertise with optimizing query performance
  • Deep understanding of data structures and schema
  • Deep understanding of Data scalability solutions such as partitions, clusters, distributions, indexing.
  • Exceptional analytical, organizational, interpersonal and communication (both oral and written) skills
  • Self-motivated, driven, resourceful and able to get things done
  • Enjoy working in fast-paced, collaborative, Agile environments
  • Ability to adapt and learn quickly is a fundamental necessity
Preferred Experience:

  • Experience with the Spark/Hadoop ecosystem
  • Experience with Kafka + Kafka Connect
  • Experience with data streaming technologies, such as Spark Streaming, Kafka Streaming and Storm.
  • Experience with continuous integration systems (Jenkins)
  • Experience with other programming languages and platforms, such as Java/Scala
  • Knowledge of columnar and no-SQL systems, such as Redshift, Aerospike and Vertica
  • Knowledge and applicable experience with agile methodologies such as SCRUM
  • Working in a production environment, preferably with a SaaS company

 

Frequently Asked Questions:

  • Benefits?  Yes, provided by ettain group
  • Remote Workers?  Not eligible, must work onsite with the team
  • Visa Sponsorship?  Not offered 
  • Corp-to-Corp?   Yes, C2C candidates are being considered

How to Apply:

 

For immediate attention please apply online and send a text message or leave a voicemail for Lily Scott at 919-328-8668. 

ettain group is a talent solutions company dedicated to matching people with the most relevant employment opportunities in IT, healthcare IT and the digital creative space. Top employers and highly skilled talent throughout the U.S. select ettain group for a better recruitment experience. Our culture empowers teams with the flexibility to deliver a superior candidate experience and client experience using market intelligence. We recruit resources, own projects and manage programs to offer a wide range of IT development and talent solutions to our clients and candidates. To learn more about ettain group visit www.ettaingroup.com. To explore more job opportunities with ettain group, visit www.ettaingroup.com/job-board.aspx