Data Solutions Architect (AWS-focused engineers for long-term cooperation)

Data Solutions Architect (AWS-focused engineers for long-term cooperation)

Full-time, B2B contract, with 4-5 hours of overlap with the EST timezone (North America)

About the role:

Our value to our customers centers around our ability to provide deep technical guidance based on their business needs. We achieve this by assigning small, virtual teams of highly skilled individuals to each client. Within these teams, the Data Solutions Architect is responsible for providing technical expertise and leadership to Data Engineers, while also maintaining a systems view that is able to reconcile technical decisions with broader project goals. Data Solutions Architect work alongside our Principal Consultants to ensure our project deliverables meet stakeholders’ needs while upholding OpsGuru’s quality and operational maturity standards.

What you’ll be doing:

Project Delivery:

• Provide deep technical expertise and leadership across a range of cloud data technologies. You will be the go-to person for driving tool selection, resolving complex engineering issues, and guiding best practices during engagements.
• Lead the design and implementation of data platforms to meet customers’ business requirements.
• Lead whiteboard design sessions with internal and external team members.
• Identify and communicate technical risks as they emerge over the course of a project.
• Work closely with Principal Consultants to extract project requirements during technical discovery sessions, define deliverables to meet those requirements, and break down those deliverables into a technical roadmap.
• Manage scope within customer engagements. Identify changing requirements as they arise, determine their impact on scope, and ensure all stakeholders are aware and agree with the changes.
• Maintain a close working relationship with the customer, as a “Trusted Advisor”. Set clear expectations, challenge assumptions, solicit feedback, and take ownership of project deliverables.
• Establishing credibility and building impactful relationships with our customers

Design and Delivery:

• Design and delivery of the following:
• Complex ETL/ELT processes, large-scale batch and real-time stream processing solutions, and optimizing data and schemas
• Data Lakes using native cloud tools or leveraging 3rd party platforms (for example Snowflake or Databricks)
• AI-based solutions for NLP, speech and video recognition, anomaly and fraud detection, chatbots, etc.
• End-to-end data solutions from ingestion pipelines, cataloging, analysis, and sharing insights (for example reports, dashboards, ML forecasts/predictions, etc.)
• Migrations and transformations of data services such as relational databases, NoSQL databases, and Data Warehouses (heterogeneous and homogeneous)
• Designing, building, training, and optimizing AI/ML solutions
• Designing and integrating MLOps solutions to support model lifecycle automation

Other Technical:

• Developing code using Python, Java, and Scala languages
• Architect and operationalize solutions following best practices including data governance, privacy, lifecycle management, and cost optimization
• Maintain relevant certifications on cloud and data technologies and stay informed of key industry trends

Your skills & experience:

Technical:

• 3+ years of experience in public cloud environments (AWS a must, GCP advantage).
• 5 + years of developing code using Python and Scala languages
• Experience building complex data engineering pipelines and ETL/ELT tasks
• Experience building real-time streaming solutions leveraging technologies such as: Kafka, Kinesis, Pub/Sub messaging, event buses, or Spark Streaming
• Considerable experience with relational databases (for example Oracle, SQL Server, MySQL, Postgres, MariaDB) or managed cloud RDBMS services (such as Amazon Aurora, Azure SQL, GCP CloudSQL, GCP Cloud Spanner, etc.)
• Considerable experience with NoSQL databases such as MongoDB, Cassandra, CouchDB, ElasticSearch, Neo4j, DynamoDB, BigTable, etc.
• Experience building solutions leveraging caching systems (for example Redis) and object stores (for example Amazon S3, Amazon Glacier, etc.)
• Experience in Analytics and BI solutions such as MicroStrategy, Tibco, Qlikview, or Tableau
• Experience building batch processing and real-time processing systems.
• Experience building AI/ML solutions, including operations such as ongoing training, optimizations, and model deployments.
• Experience designing, implementing, training, and optimizing ML and AI models
• Experience building Data Warehouses and Data Lakes

Consulting:

• Proven ability to discuss and design solutions using concepts such as data lineage, data quality gates, data anonymization, data governance, data security, data replication, data caching, data lifecycle management, data catalogs, and networking
• Understanding of requirements and impacts from compliance frameworks such as HIPAA, PCI, GDPR, PIPEDA, etc.
• Strong communication and presentation skills, written and verbal
• Experience writing technical documentation
• Experience in technical mentoring
• Experience working in a customer-facing delivery role in a consulting or professional services environment

What’s in it for you:

• Business to business engagement
• Fully remote collaboration