Skip to main content
T

Batch Automation (Shell Scriting, PySpark, NDM, SFTP)

Tcs Usa
4 days ago
Full-time
On-site
Irving, Texas, United States
$100,000 - $135,000 USD yearly
Information Technology

Roles & Responsibilities

  • Automate and optimize batch workflows using robust Shell scripting and file-processing techniques.
  • Manage secure file transfers using NDM (Connect: Direct) and SFTP, including monitoring, troubleshooting, and operational support.
  • Develop scalable PySpark ETL pipelines, ensuring high performance and reliability for large-scale data processing.
  • Implement automation and configuration management using Ansible, following Infrastructure as best practices.
  • Collaborate with cross-functional teams to ensure secure, reliable, and compliant data-movement operations.

Required Skills

  • Shell Scripting: Strong scripting and file-processing expertise for batch automation and workflow optimization.
  • PySpark: Hands-on experience developing scalable, high-performance, and reliable ETL pipelines for large-scale datasets.
  • NDM (Connect: Direct): Experience managing secure enterprise file transfers, monitoring transfer jobs, and troubleshooting failures.
  • SFTP: Strong knowledge of secure file-transfer operations, controls, monitoring, and issue resolution, Experience implementing automation and configuration management using Infrastructure as Code practices.
  • Operational Excellence: Ability to support secure, reliable, and compliant data movement in collaboration with cross-functional teams.