Infosys is seeking a highly experienced Data Engineering & Big Data Architect to join our team and perform Technical Product management/Data analyst tasks and own the development of a Tiered data architecture for our data platform. In this role, they would be responsible for crafting and building a comprehensive data architecture that will enable seamless data integration and enable the delivery of high-quality insights to our leadership and business stakeholders. You will collaborate with some of the best talent in the industry to create and implement innovative high-quality solutions, lead, and participate in sales and pursuits focused on our clients' business needs. You will be part of a learning culture, where teamwork and collaboration are encouraged, excellence is rewarded, and diversity is respected and valued.
Required Qualifications:
- Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 7 years of experience in Information Technology.
- Candidate must be located within commuting distance of Austin, TX/ Sunnyvale, CA or be willing to relocate to the area. This position may require travel to project locations
- Experience with Hadoop distributed frameworks while handling large amount of data using Spark or PYSpark and Hadoop Ecosystems.
- Proven experience in data engineering, data architecture, or a related field
- Experience with Spark or PySpark is required.
- Strong understanding of data modeling, data warehousing, and ETL concepts
- Proficiency in SQL and experience with at least one major data analytics platform, such as Hadoop or Spark
- Experience with Scala or Python is required.
Preferred Qualifications:
- Experience in understanding of Design Patterns, ability to discuss tradeoffs between RDBMS vs Distributed Storage
- At least 5 years of Experience with Spark or PySpark, Python, Scala and Data Engineering
- Experience in design and implementing a tiered data architecture that integrates analytics data from multiple sources in an efficient and effective manner.
- Experience with data orchestration tools like Airflow is a nice to have.
- Excellent problem-solving and analytical skills, and the ability to work well under tight deadlines.
- Excellent interpersonal skills and the ability to collaborate effectively with cross-functional teams.
- Experience in developing data models and mapping rules to transform raw data into actionable insights and reports.
- Experience in collaborating with the analytics and business teams to understand their requirements, with cross-functional teams to define and implement data governance policies and standards.
- Experience in developing data validation and reconciliation processes to ensure data quality and accuracy is met.
- Experience with development and maintenance of user documentation, including data models, mapping rules, and data dictionaries.
Estimated annual compensation range for candidate based in the below locations will be:
Sunnyvale, CA- $104079 -$175310
Along with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits :-
- Medical/Dental/Vision/Life Insurance
- Long-term/Short-term Disability
- Health and Dependent Care Reimbursement Accounts
- Insurance (Accident, Critical Illness , Hospital Indemnity, Legal)
- 401(k) plan and contributions dependent on salary level
- Paid holidays plus Paid Time Off
The job entails sitting as well as working at a computer for extended periods of time. Should be able to communicate by telephone, email or face to face. Travel may be required as per the job requirements.