Senior Data Engineer #: 21-00678

Company: HireTalent Executive Search, Temporary Staffing, R
Location: Hillsboro
Posted on: February 20, 2021

Job Description:

Job DescriptionJob Title: Senior Data EngineerJob Location: Hillsboro, ORJob Duration: 12 Months Our client has embraced big data technologies to enable data-driven decisions. We're looking to expand our Data Engineering team to keep pace. As a Senior Data Engineer, you will work with a variety of talented our client teammates and be a driving force for building first-class solutions for our client Technology and its business partners, working on development projects related to supply chain, commerce, consumer behavior and web analytics among others.Role Responsibilities* Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology* Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes* Translate product backlog items into engineering designs and logical units of work* Profile and analyze data for the purpose of designing scalable solutions * Define and apply appropriate data acquisition and consumption strategies for given technical scenarios* Design and implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem* Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns* Implement complex automated routines using workflow orchestration tools * Work with architecture, engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to* Anticipate, identify and solve issues concerning data management to improve data quality* Build and incorporate automated unit tests and participate in integration testing efforts* Utilize and advance continuous integration and deployment frameworks* Troubleshoot data issues and perform root cause analysis* Work across teams to resolve operational & performance issuesThe following qualifications and technical skills will position you well for this role:* MS/BS in Computer Science, or related technical discipline* 5+ years of experience in large-scale software development, 3+ years of big data experience* Strong programming experience, Python preferred* Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, etc.* Experience with messaging/streaming/complex event processing tooling and frameworks with an emphasis on Spark Streaming or Structured Streaming and Apache Nifi* Good understanding of file formats including JSON, Parquet, Avro, and others* Familiarity with data warehousing, dimensional modeling, and ETL development* Experience with RDBMS systems, SQL and SQL Analytical functions* Experience with workflow orchestration tools like Apache Airflow* Familiarity with data warehousing, dimensional modeling, and ETL development* Experience with performance and scalability tuningThe following skills and experience are also relevant to our overall environment, and nice to have:* Experience with Scala or Java* Experience working in a public cloud environment, particularly AWS, and with services like EMR, S3, Lambda, ElastiCache, DynamoDB, SNS, SQS, etc* Familiarity with cloud warehouse tools like Snowflake* Experience building RESTful API's to enable data consumption* Familiarity with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI* Familiarity with practices like Continuous Development, Continuous Integration and Automated Testing* Experience in Agile/Scrum application developmentWe Would Love To Hear From Candidates Who Embody The SameThese are the characteristics that we strive for in our own work.* Desire to work collaboratively with your teammates to come up with the best solution to a problem* Demonstrated experience and ability to deliver results on multiple projects in a fast-paced, agile environment* Excellent problem-solving and interpersonal communication skills* Strong desire to learn and share knowledge with others

Keywords: HireTalent Executive Search, Temporary Staffing, R, Hillsboro , Senior Data Engineer #: 21-00678, Engineering , Hillsboro, Oregon