Employee code: #4804
Post date: Jul/01/2024
Savvients Inc. has openings for the position of Software Developer which requires a U.S. master’s or foreign equivalent degree in Computer Science, Information Technology, or a related field and minimum of 1 year of experience in designing, developing, and testing data pipelines to extract transform and load large volumes of data from various source systems using Python, Java, Scala and Hadoop technologies. Design/Implement large scale pub-sub message queues using Apache Kafka for data ingestion. Create automated pipelines to deploy Docker containers in cloud-based infrastructure such as Amazon EC2 Working with the business user’s and stakeholders in getting the requirement and converting the business requirements into User Stories using JIRA.
Duties: Responsible for Designing developing and testing data pipelines to extract transform and load large volumes of data from various structured and unstructured sources. Responsible for designing an application for ETL processes using Sqoop, Spark, Spark SQL, Scala, and Oozie. Responsible for Designing the database SQL and stored procedures for periodical updating operations. Develop Spark scripts using Python on AWS for Data Aggregation, Validation and verified its performance over MR jobs. Use Sqoop to import data into HDFS/Hive from multiple relational databases, performed operations and exported the results. Write HiveQL queries by configuring number of reducers and mappers in query needed for the output. Use Spark for interactive queries, processing of streaming data and integrated with popular NoSQL databases. Develop the batch scripts to fetch the data from various SQL and NoSQL data sources and do require transformations. Develop Kafka consumer API in Scala for consuming data from Kafka topics. Develop Real-time Processing and core jobs using Spark Streaming with Kafka as a data pipe-line system using Scala programming. Develop unit and functional test cases and test scripts for multiple test environments in the organization. Track and manage engineering and development using agile/iterative software development practices with the help of tools such as Jira. Participate in daily scrum meetings, design discussions, and other status meetings.
Full time – 40 hrs./week. M-F. Job location: Chandler, Arizona. Must be authorized to work in the United States. Mail resumes to HR at Savvients Inc., 1490 S Price Rd., Suite 204, Chandler, Arizona 85286 Or Email Resumes to [email protected]