Job added in hotlist
Applied job
Contract job
Recruiter job
Employer job
Expanded search
Apply online not available
Similar Jobs
Knowledge Management Analyst
General Nutrition Centers, Inc.
Pittsburgh, PA
Apply Now >
Technical Writer, Software Engineering
Google, Inc.
Pittsburgh, PA
Apply Now >
marketing copywriter
Pittsburgh, PA
Apply Now >
Title/Oil & Gas Attorney, 2-6 Pittsburgh firm
McAnney, Esposito & Kraybill Associates, Inc.
Pittsburgh, PA
Apply Now >
Content Editor
FlexJobs Corporation
Pittsburgh, PA
Apply Now >
View more jobs in Cranberry Twp, PA
View more jobs in Pennsylvania

Job Details

software engineer iv big data cloud

Company name
RecruiterDNA | DevOpsDNA

$120,000 to

Cranberry Twp, PA

Apply for this job

6 hit(s)  


Sr or Lead Data Software Engineer

Each day you will make an impact.


* Develop custom batch-oriented and real-time streaming data pipelines working within the MapReduce ecosystem, migrating flows from ELT to ETL

* Ensure proper data governance policies are followed by implementing or validating data lineage, quality checks, classification, etc.

* Act in a technical leadership capacity: Mentor junior engineers and new team members, and apply technical expertise to challenging programming and design problems

* Resolve defects/bugs during QA testing, pre-production, production, and post-release patches

* Have a quality mindset, squash bugs with a passion, and work hard to prevent them in the first place through unit testing, test-driven development, version control, continuous integration and deployment.

* Ability to lead change, be bold, and have the ability to innovate and challenge status quo

* Be passionate about solving customer problems and develop solutions that result in a passionate customer/community following

* Conduct design and code reviews

* Analyze and improve efficiency, scalability, and stability of various system resources

* Contribute to the design and architecture of the project

* Operate within Agile Development environment and apply the methodologies

Required Knowledge and Skills:

* Proficient understanding of distributed computing principles

* Experience developing ETL processing flows using MapReduce technologies like Spark and Hadoop

* Experience developing with ingestion and clustering frameworks such as Kafka, Zookeeper, YARN

* Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming

* Experience with various messaging systems, such as Kafka or RabbitMQ

* Good knowledge of Big Data querying tools, such as Pig or Hive

* Good understanding of Lambda Architecture, along with its advantages and drawbacks

* Proficiency with MapReduce, HDFS

* Experience with integration of data from multiple data sources

* Ability to solve any ongoing issues with operating the cluster

Basic Qualifications:

* Bachelors degree required or equivalent experience

* 4 years experience in software engineering

Preferred Qualifications:

* Master Degree

* 8 years experience in software engineering

* Demonstrable advanced knowledge of data architectures, data pipelines, real time processing, streaming, networking, and security

* 1 years experience with DataBricks and Spark

* Management of Spark or Hadoop clusters, with all included services

* 1 years experience with NoSQL databases, such as HBase, Cassandra, MongoDB

* 1 years experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O

* Demonstrable understanding of Service Oriented Architecture

* 1 years experience in Technical writing, system documentation, design document-management skills

* 2 years experience with Scala or Java Language as it relates to product development.

Job Type


Job ID


Enter your details to join Resume-Library and apply for this role


First Name

Last Name

This email already exists

Enter your password to login and apply

Forgotten your password?

Apply Now

Company info

RecruiterDNA | DevOpsDNA

Company Profile

Similar Jobs:
Social Video Editor
Location : Pittsburgh, PA
Freelance opportunity. Will write articles, research content, and work to grow social accounts. Must have digital content editing experience and strong knowledge of Adobe Creative Suite. Social media background needed. Job Details...
Editor Assignment
Location : Pittsburgh, PA
See more jobs like this Description WPXI-TV is looking for a smart, creative and enthusiastic newsroom professional to join our award winning team in Pittsburgh, PA. We are looking for a newsroom leader with a drive to win weather...
Technical Writer
Location : Pittsburgh, PA
See more jobs like this Role: Technical Trainer Strong interpersonal skills Strong analytical skills Strong oral and written skills Expected to work effectively as a team member in a fast-paced environment. Responsible for assisti...
The number of jobs listed on EmploymentCrossing is great. I appreciate the efforts that are taken to ensure the accuracy and validity of all jobs.
Richard S - Baltimore, MD
  • All we do is research jobs.
  • Our team of researchers, programmers, and analysts find you jobs from over 1,000 career pages and other sources
  • Our members get more interviews and jobs than people who use "public job boards"
Shoot for the moon. Even if you miss it, you will land among the stars.
WritingCrossing - #1 Job Aggregation and Private Job-Opening Research Service — The Most Quality Jobs Anywhere
WritingCrossing is the first job consolidation service in the employment industry to seek to include every job that exists in the world.
Copyright © 2018 WritingCrossing - All rights reserved. 21