They chose the Quanser Autonomous Vehicle Research Studio, with its QDrone quadrotors and QBot ground robots. “It’s a very smart system and gives us a lot of flexibility,” says Dr. Durdevic. “We did not have to do any hardware development. Instead, we could focus on our theoretical research. Using the QDrone, we could quickly implement some of our advanced techniques, test them, and validate them.”
As a first step, the team started looking at how to navigate in the environment, combining classical control with vision-based methods. The task at this stage was to recognize a wind turbine visually and then autonomously navigate towards it without using GPS.
For their initial work, the team used the Quanser-developed controllers. “We wanted to get acquainted with the system while focusing on this crazy idea to use deep neural networks to compute the inputs to our attitude and position controllers,” says Dr. Durdevic. “It worked very well for us,” he continues. With all computing done in Matlab/Simulink, learning to work with the Autonomous Vehicles Research Studio was rather intuitive for the team as they are accustomed to the same tools from other teaching and research activities.
As the team got more familiar with the system, they expanded on the idea of using neural networks, this time using the method for visual servoing, to be able to navigate in an off-shore environment, find a wind turbine, navigate towards it, and use vision for inspection.
They developed an algorithm segmenting the visual input from the camera, then processing the segments using a neural network trained to find the wind turbine, and calculating the drone’s relative position to the wind turbine. Once the drone identifies the wind turbine, it uses the visual input for both collision avoidance and yaw control as it moves towards it.
Again, having the QDrones was extremely useful. “We were really happy that we had the Quanser system,” says Dr. Durdevic. “Testing our approach and running neural networks required a lot of the resources from the GPU, but everything worked very well.”
The other reason the team at Aalborg University chose the Quanser autonomous vehicles platform was achieving their teaching objectives. “The university embraces a problem- and project-based learning,” notes Dr. Durdevic. That means Aalborg students spend 50% of their time working on projects. “We want to give students good projects that motivate them and teach them useful skills, continues Dr. Durdevic. “We chose to invest in the Quanser system because we didn’t have to spend time on soldering and pulling wires ourselves. Our focus is on developing control algorithm and AI, not building drones.”