The hourly rate for this position is $19.67 per hour for Undergraduate III and is non-negotiable.

This position is open until filled

Under direction, incumbents must have course work in the discipline requested on the task order Statement of Work.

This Statement of Work covers the need for student services to support research and development activities related to reinforcement learning (RL) algorithms for modeling adaptive target behaviors. Under the guidance of the engineering team, the student will contribute to the design, implementation, and evaluation of RL agents and simulation environments. Work will include developing custom RL environments using Gymnasium, implementing and training agents with Stable Baselines3, and assisting in the analysis of agent performance within active sonar operational scenarios. The student will participate in iterative experimentation, documentation of methods and results, and preparation of technical materials for potential publication or presentation. Tasks will be scoped to match the student s academic background and skill level, with opportunities to gain experience in applied machine learning, simulation development, and defense-focused AI research.

The AIRED project focuses on researching and developing machine learning-based technical solutions to advance the Navy s ability to model intelligent, adaptive target behaviors in active-sonar Anti-Submarine Warfare (ASW) environments. Today s decision-support tools primarily emphasize acoustic performance prediction and often lack representations of reactive, tactically aware target decision-making. AIRED aims to address this gap by creating reinforcement learning (RL) agents that can learn and demonstrate realistic, adaptive behaviors in simulated operational scenarios. By building models that behave more like real targets, the project will help improve the realism of training tools, support the development of new tactics and sensor strategies, and ultimately strengthen the Navy s ability to plan and operate in complex undersea environments.

The student contractor shall provide analytical and technical support in the following areas as specified under individual task orders, to the work sponsor.

Software Engineering, Programming:

• Assist with the design, development, and sustainment of custom RL environments using Gymnasium.
• Assist with implementation, training, and optimization of RL agents using the Stable Baselines3 framework.
• Develop Python-based software modules with strong adherence to coding standards, documentation practices, and reproducible experimentation workflows.
• Apply core RL concepts, including policy optimization methods (e.g., PPO), action and state space design, and reward shaping, to support model development and evaluation.
• Utilize Stable Baselines3 and Gymnasium to integrate, test, and refine RL algorithms within simulation environments.
• Use Git for version control, including branching, merging, and maintaining clean commit histories to support collaborative development.
• Demonstrate effective problem solving skills by identifying issues, proposing solutions, and iteratively improving model performance and software reliability.
• Engage proactively in learning new tools, frameworks, and methods relevant to machine learning, simulation development, and reinforcement learning research.

Undergraduate Student 3: Must have course work in the discipline requested on the task order Statement of Work. The student must be at the Senior level and have experience in 100% of the task requirements and be able to accomplish 90% of the work independently. Is not required to be an SDSU Student.

Minimum Qualifications Requirements:

Undergraduate 3: Computer Science major preferred; relevant majors such as Data Science or Cognitive Science will be suitable given relevant coursework and/or work experience.

Required Coursework and/or relevant work and/or laboratory experience:

• Machine Learning Algorithms
• Programming
• Design & Analysis of Algorithms
• Data Structures
• Data Science

Desired Coursework and/or relevant work and/or laboratory experience:

• Neural Networks/Deep Learning
• Linear Algebra
• Probability

Desired Qualifications:

• Python software programming experience.
• Experience with GIT and version control.
• Experience in reinforcement learning.
• Ability to read and implement technical documents or test standards.
• Comfortable with working independently and in group settings.
• Independent/self-starter who can operate under minimal oversight.
• Collaborative/team-player who can work well with groups.

ADDITIONAL APPLICANT INFORMATION:

• This position will require the employee to obtain and maintain a DoD Secret security clearance.
• The student will work at NIWC Pacific Bayside.
• Due to the regulations established by the Department of Defense, only US Citizens may qualify.
• This is a student position and is limited to working 20 hours per week.
• This position will remain open until filled.
• Candidate must reside in California and live within a commutable distance from SDSU at time of hire.
• Job offer is contingent upon satisfactory clearance based on background check results (including a criminal record check).
• San Diego State University Research Foundation is an equal opportunity employer. Consistent with California law and federal civil rights laws, SDSU Research Foundation provides equal opportunity in employment without unlawful discrimination or preferential treatment based on race, sex, color, ethnicity, or national origin or any other categories protected by federal or state law.  
• Employment decisions are based on an individual’s qualifications as they relate to the job under consideration. Our commitment to equal opportunity means ensuring that every employee has equal access to resources and support. 
• SDSU Research Foundation complies with Titles VI and VII of the Civil Rights Act of 1964, Title IX of the Education Amendments of 1972, the Americans with Disabilities Act (ADA), Section 504 of the Rehabilitation Act, the California Equity in Higher Education Act, California’s Proposition 209 (Art. I, Section 31 of the California Constitution), and other applicable state and federal anti-discrimination laws including grant or contract terms and conditions related to funded program activities. Further the SDSU Research Foundation maintains a Nondiscrimination Policy that prohibits discriminatory preferential treatment, segregation based on race or any other protected status, and all forms of unlawful discrimination, harassment, and retaliation in all programs, policies, and practices.  
• SDSU Research Foundation makes all employment decisions including, but not limited to, applicant screening, hiring, promotion, demotion, compensation, benefits, disciplinary actions, and terminations on the basis of merit.