Attitude control of a nanosatellite system using reinforcement learning and neural networks

Deigant Yadava, Raunak Hosangadi, Sai Krishna, Pranjal Paliwal, Avi Jain

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper describes a robust and efficient attitude determination and control system on-board a nanosatellite that makes use of the concepts of neural networks and reinforcement learning to develop an attitude control algorithm which can provide the required torque for stabilization of the satellite body along all three axes. The control system under consideration takes data from six sun sensors (one on each of the panels of the satellite body), a magnetometer and a gyroscope, placed inside the satellite, as input. It also requires the input from an on-board GPS module, which is run once per orbit (ideally) due to constraints of electric power in a nanosatellite system. The system consists of multiple stages, the first of which is running the orbit propagator. This will make use of the latest position and velocity vectors obtained from the GPS module for estimating the current position of the satellite, since the GPS module cannot be run on each iteration of the algorithm. The proposed system makes use of a neural network to perform the task of the orbit propagator, by forming a non-linear function for position estimation. Next, using the position vector of the satellite, the ideal orientation of the satellite is estimated in terms of the ideal magnetic field vector (using the IGRF model) and the ideal sun vector (in the orbit frame). These are then fed into the controller along with the measured magnetic field vector and the sun vector (in the body frame) to get the required torque. The controller mainly consists of two neural networks to give the torques which will help in the stabilization of the satellite. The neural networks in the controller are trained using reinforcement learning and temporal difference learning, using a modification of the actor - critic algorithm in reinforcement learning. The controller will be trained before the launch of the satellite using Software in the Loop (SIL) simulations of the desired orbit of the satellite to tune the parameters of the neural networks. Further, once the satellite is in orbit, the controller will be tuned after fixed intervals of time to adjust to any changes in the environment in the orbit.

Original languageEnglish
Title of host publication2018 IEEE Aerospace Conference, AERO 2018
PublisherIEEE Computer Society
Pages1-8
Number of pages8
Volume2018-March
ISBN (Electronic)9781538620144
DOIs
Publication statusPublished - 25-06-2018
Externally publishedYes
Event2018 IEEE Aerospace Conference, AERO 2018 - Big Sky, United States
Duration: 03-03-201810-03-2018

Conference

Conference2018 IEEE Aerospace Conference, AERO 2018
CountryUnited States
CityBig Sky
Period03-03-1810-03-18

Fingerprint

Nanosatellites
nanosatellites
attitude control
Attitude control
Reinforcement learning
reinforcement
learning
Satellites
Neural networks
Orbits
orbits
controllers
Controllers
torque
Sun
Global positioning system
GPS
Torque
modules
control system

All Science Journal Classification (ASJC) codes

  • Aerospace Engineering
  • Space and Planetary Science

Cite this

Yadava, D., Hosangadi, R., Krishna, S., Paliwal, P., & Jain, A. (2018). Attitude control of a nanosatellite system using reinforcement learning and neural networks. In 2018 IEEE Aerospace Conference, AERO 2018 (Vol. 2018-March, pp. 1-8). IEEE Computer Society. https://doi.org/10.1109/AERO.2018.8396409
Yadava, Deigant ; Hosangadi, Raunak ; Krishna, Sai ; Paliwal, Pranjal ; Jain, Avi. / Attitude control of a nanosatellite system using reinforcement learning and neural networks. 2018 IEEE Aerospace Conference, AERO 2018. Vol. 2018-March IEEE Computer Society, 2018. pp. 1-8
@inproceedings{90d6280199f54a3491d5cc2a56d637f2,
title = "Attitude control of a nanosatellite system using reinforcement learning and neural networks",
abstract = "This paper describes a robust and efficient attitude determination and control system on-board a nanosatellite that makes use of the concepts of neural networks and reinforcement learning to develop an attitude control algorithm which can provide the required torque for stabilization of the satellite body along all three axes. The control system under consideration takes data from six sun sensors (one on each of the panels of the satellite body), a magnetometer and a gyroscope, placed inside the satellite, as input. It also requires the input from an on-board GPS module, which is run once per orbit (ideally) due to constraints of electric power in a nanosatellite system. The system consists of multiple stages, the first of which is running the orbit propagator. This will make use of the latest position and velocity vectors obtained from the GPS module for estimating the current position of the satellite, since the GPS module cannot be run on each iteration of the algorithm. The proposed system makes use of a neural network to perform the task of the orbit propagator, by forming a non-linear function for position estimation. Next, using the position vector of the satellite, the ideal orientation of the satellite is estimated in terms of the ideal magnetic field vector (using the IGRF model) and the ideal sun vector (in the orbit frame). These are then fed into the controller along with the measured magnetic field vector and the sun vector (in the body frame) to get the required torque. The controller mainly consists of two neural networks to give the torques which will help in the stabilization of the satellite. The neural networks in the controller are trained using reinforcement learning and temporal difference learning, using a modification of the actor - critic algorithm in reinforcement learning. The controller will be trained before the launch of the satellite using Software in the Loop (SIL) simulations of the desired orbit of the satellite to tune the parameters of the neural networks. Further, once the satellite is in orbit, the controller will be tuned after fixed intervals of time to adjust to any changes in the environment in the orbit.",
author = "Deigant Yadava and Raunak Hosangadi and Sai Krishna and Pranjal Paliwal and Avi Jain",
year = "2018",
month = "6",
day = "25",
doi = "10.1109/AERO.2018.8396409",
language = "English",
volume = "2018-March",
pages = "1--8",
booktitle = "2018 IEEE Aerospace Conference, AERO 2018",
publisher = "IEEE Computer Society",
address = "United States",

}

Yadava, D, Hosangadi, R, Krishna, S, Paliwal, P & Jain, A 2018, Attitude control of a nanosatellite system using reinforcement learning and neural networks. in 2018 IEEE Aerospace Conference, AERO 2018. vol. 2018-March, IEEE Computer Society, pp. 1-8, 2018 IEEE Aerospace Conference, AERO 2018, Big Sky, United States, 03-03-18. https://doi.org/10.1109/AERO.2018.8396409

Attitude control of a nanosatellite system using reinforcement learning and neural networks. / Yadava, Deigant; Hosangadi, Raunak; Krishna, Sai; Paliwal, Pranjal; Jain, Avi.

2018 IEEE Aerospace Conference, AERO 2018. Vol. 2018-March IEEE Computer Society, 2018. p. 1-8.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Attitude control of a nanosatellite system using reinforcement learning and neural networks

AU - Yadava, Deigant

AU - Hosangadi, Raunak

AU - Krishna, Sai

AU - Paliwal, Pranjal

AU - Jain, Avi

PY - 2018/6/25

Y1 - 2018/6/25

N2 - This paper describes a robust and efficient attitude determination and control system on-board a nanosatellite that makes use of the concepts of neural networks and reinforcement learning to develop an attitude control algorithm which can provide the required torque for stabilization of the satellite body along all three axes. The control system under consideration takes data from six sun sensors (one on each of the panels of the satellite body), a magnetometer and a gyroscope, placed inside the satellite, as input. It also requires the input from an on-board GPS module, which is run once per orbit (ideally) due to constraints of electric power in a nanosatellite system. The system consists of multiple stages, the first of which is running the orbit propagator. This will make use of the latest position and velocity vectors obtained from the GPS module for estimating the current position of the satellite, since the GPS module cannot be run on each iteration of the algorithm. The proposed system makes use of a neural network to perform the task of the orbit propagator, by forming a non-linear function for position estimation. Next, using the position vector of the satellite, the ideal orientation of the satellite is estimated in terms of the ideal magnetic field vector (using the IGRF model) and the ideal sun vector (in the orbit frame). These are then fed into the controller along with the measured magnetic field vector and the sun vector (in the body frame) to get the required torque. The controller mainly consists of two neural networks to give the torques which will help in the stabilization of the satellite. The neural networks in the controller are trained using reinforcement learning and temporal difference learning, using a modification of the actor - critic algorithm in reinforcement learning. The controller will be trained before the launch of the satellite using Software in the Loop (SIL) simulations of the desired orbit of the satellite to tune the parameters of the neural networks. Further, once the satellite is in orbit, the controller will be tuned after fixed intervals of time to adjust to any changes in the environment in the orbit.

AB - This paper describes a robust and efficient attitude determination and control system on-board a nanosatellite that makes use of the concepts of neural networks and reinforcement learning to develop an attitude control algorithm which can provide the required torque for stabilization of the satellite body along all three axes. The control system under consideration takes data from six sun sensors (one on each of the panels of the satellite body), a magnetometer and a gyroscope, placed inside the satellite, as input. It also requires the input from an on-board GPS module, which is run once per orbit (ideally) due to constraints of electric power in a nanosatellite system. The system consists of multiple stages, the first of which is running the orbit propagator. This will make use of the latest position and velocity vectors obtained from the GPS module for estimating the current position of the satellite, since the GPS module cannot be run on each iteration of the algorithm. The proposed system makes use of a neural network to perform the task of the orbit propagator, by forming a non-linear function for position estimation. Next, using the position vector of the satellite, the ideal orientation of the satellite is estimated in terms of the ideal magnetic field vector (using the IGRF model) and the ideal sun vector (in the orbit frame). These are then fed into the controller along with the measured magnetic field vector and the sun vector (in the body frame) to get the required torque. The controller mainly consists of two neural networks to give the torques which will help in the stabilization of the satellite. The neural networks in the controller are trained using reinforcement learning and temporal difference learning, using a modification of the actor - critic algorithm in reinforcement learning. The controller will be trained before the launch of the satellite using Software in the Loop (SIL) simulations of the desired orbit of the satellite to tune the parameters of the neural networks. Further, once the satellite is in orbit, the controller will be tuned after fixed intervals of time to adjust to any changes in the environment in the orbit.

UR - http://www.scopus.com/inward/record.url?scp=85049849606&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049849606&partnerID=8YFLogxK

U2 - 10.1109/AERO.2018.8396409

DO - 10.1109/AERO.2018.8396409

M3 - Conference contribution

VL - 2018-March

SP - 1

EP - 8

BT - 2018 IEEE Aerospace Conference, AERO 2018

PB - IEEE Computer Society

ER -

Yadava D, Hosangadi R, Krishna S, Paliwal P, Jain A. Attitude control of a nanosatellite system using reinforcement learning and neural networks. In 2018 IEEE Aerospace Conference, AERO 2018. Vol. 2018-March. IEEE Computer Society. 2018. p. 1-8 https://doi.org/10.1109/AERO.2018.8396409