Data Integration Developer (Azure and AI Solutions)

  • Full time role with a hybrid working model
  • Join a high performing, collaborative and friendly team
  • Located in the heart of Sydney's CBD (Martin Place)

The Law Society of NSW is Australia's largest and most influential membership association for solicitors. We're not all lawyers, but we work together to support the legal profession and ensure a just society for all.

We are currently looking for a Data Integration Developer (Azure & AI Solutions) to join our Information Management team.

About the role

Leveraging technologies such as Azure Data Factory, Logic Apps, Azure Data Lake, SQL, and Databricks, the Data Integration Developer (Azure & AI Solutions) will play a key role in designing, developing, and maintaining data pipelines and integrations that enable informed decision-making and advance the organisation’s strategic objectives.

What you'll be doing

  • Design, build, and maintain scalable and secure data integration solutions using Azure Data Factory, Logic Apps, Azure Data Lake, and Databricks.
  • Develop and optimise data pipelines for ingestion, transformation, and distribution of structured and unstructured data from various internal and external sources.
  • Implement best practices for data architecture, ETL/ELT design, and data governance.
  • Integrate AI capabilities (e.g., cognitive services, machine learning models, automation tools) to support intelligent workflows and enhance operational efficiency.
  • Monitor and troubleshoot data integration processes to ensure high data quality and availability.
  • Work closely with other teams to understand data requirements and ensure the proper integration of disparate systems
  • Provide technical support and troubleshooting for data integration processes, ensuring smooth and accurate data transfer and processing
  • Ensure high-quality, reliable data integration by implementing robust validation, monitoring, and error handling strategies
  • Work in accordance with the organisation's data governance policies and ensure compliance with data security and privacy standards
  • Collaborate with cross-functional teams to gather data requirements and translate them into technical specifications
  • Provide documentation of data processes, integration workflows, and system configurations for future reference and team use
  • Evaluate new technologies and tools in the Azure ecosystem and recommend improvements or enhancements to existing systems
  • Continuously optimise data integration processes to improve performance, scalability, and cost-efficiency
  • Define the Data and Data Integration strategy by focusing on business decision automation through quality information, and developing a single source of information truth for all business users
  • Administer and apply data-fixes to both internally and externally developed business-critical systems
  • Troubleshoot and correct issues on various application databases such as Azure SQL and Oracle
  • Identify potential faults within the Data Integrations and Data Warehouse and take a proactive approach to address the issue
  • Pro-actively engage with various business stakeholders to encourage adoption and automation using the Information Management services
  • Collaborate with data engineers, analysts, business units, and stakeholders to understand data requirements and deliver effective solutions.
  • Provide technical guidance and mentoring to other developers and team members
  • Document system processes, configurations, and best practices
  • Ensure clear processes are in place for new request management
  • Collaborate with Boomi developers to build, support, and optimise integrations and data flows
  • Assist in troubleshooting and resolving issues related to Boomi integrations and workflows
  • Ensure seamless integration between Boomi-based and Azure-based systems, facilitating smooth data exchange and management
  • Collaborate with cross-functional teams and assist other developers with development, support and maintenance of our Oracle platforms
  • Report on task/project progress to manager and IT reporting as required
  • Focus on improving / maintaining the perception of IT within the business
  • Providing training to staff (both internally and externally) on IT IM Services
  • Ensuring all policies, procedures and processes are followed at all times
  • Maintain all documentation for continual use and ease of new staff joining the team
  • Standardise and highlight improvements to services

About you

  • 5+ years providing support to both internally and externally developed business-critical production
  • 5+ years of proven experience with Azure Data Factory, Logic Apps, Azure Data Lake, and Azure SQL
  • 3+ years designing and developing Data Integration and Data Warehouse solutions including ETL/ELT design and data modelling
  • 2+ years of hands-on experience in Oracle PL/SQL and database management
  • 2+ years of hands-on experience in AI and machine learning concepts and how they can be integrated into business processes
  • 2+ years of hands-on experience with Databricks
  • 1+ hands-on experience in Python, or Scala for data transformation and pipeline development
  • 1+ years of hands-on experience with Boomi integration and flow development
  • 1+ years of Dev-Ops processes (including CI/CD) and Infrastructure as code fundamentals
  • Strong proficiency in Azure Data Factory for building and managing data pipelines
  • Strong problem-solving skills and a proactive approach to innovation and automation
  • Experience in implementing data security, privacy, and compliance controls in cloud environments
  • Strong knowledge of SQL and data modelling
  • Familiarity with scripting languages (e.g., Python, PowerShell) and other integration tools
  • Fundamental database administration skills (Azure SQL, Oracle DB, MySQL)
  • Understanding of various Datawarehouse methodologies such as Data Vault and Kimball
  • Experience with big data solutions, real-time data streaming, or machine learning pipelines
  • Strong data analysis, discovery and problem-solving skills
  • Strong communication skills, both verbal and written
  • Time Management skills
  • Self-motivated with a passion for learning and adopting new technologies
  • Attention to detail.
Preferred Qualifications:
  • Certification in Microsoft Azure (e.g., Azure Data Engineer Associate, Azure Solutions Architect Associate)
  • Certification in Databricks or AI/ML platforms is a plus
  • Certification in Oracle Database
  • Certification in Boomi
  • Tertiary qualifications in Information Systems, Computing Science or similar

To apply

The Law Society of New South Wales is committed to building and maintaining a respectful and inclusive workplace, appointing the best person for the role and supporting diversity.

Applications should contain a CV and cover letter that outlines your key experience and motivations for this role.

Closes