357
edits
(4 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
== ROBOT | == WORM ROBOT== | ||
Line 24: | Line 24: | ||
My first idea was to design a | My first idea was to design a robot that simulates the neuromuscular function of a C. elegans. The design was a bio-inspired agent living a simplified bio-inspired environment. The robot would be trained with deep reinforcement learning which is an area of machine learning concerned with how intelligent agents learn to achieve a goal in a potentially complex environment with trial and error. The agent wants to achieve staying alive as long as possible. Finding bacteria and avoiding heat helps it to stay alive. It gets either rewards or penalties for the actions it performs. Its goal is to maximize the total reward. (At the end of the page you will find a presentation about this design.) | ||
The first robot design is equipped with wheels, on board processor, voltage regulator, batteries, distance sensor, color sensor, thermo sensor which allows it to locomote in a snakelike manner, find food sources (bacteria) and avoid heat. | The first robot design is equipped with wheels, on board processor, voltage regulator, batteries, distance sensor, color sensor, thermo sensor which allows it to locomote in a snakelike manner, find food sources (bacteria) and avoid heat. | ||
Line 44: | Line 44: | ||
{{#ev:youtube|wCLxQFqpN-A|700}} | {{#ev:youtube|wCLxQFqpN-A|700}} | ||
===Research=== | ===Research / Inspiration=== | ||
What is special about C. Elegans is that they are among the best understood animal. Its whole genome was sequenced and it is the only creature to have had its neural system completely simulated. It has 302 neurons hard wired with around 8000 connections. We have a complete map of C. Elegan's admittedly simple, neural circuit created by [https://http://openworm.org/ Open Worm Project] .This model has been used to implement the worm's brain in a number of ways including building an artificial version of the worm's brain and building devices seem to behave like the worm. The researches concerning how the neural system of C. Elegans uploaded to a computer to solve a problem and mimiking digital evolutionary process of C. Elegans using deep reinforcement learning in in a nature-like simulation are the main inspirations for my project. You will see details of these researches in my references and research notes section. Below is a simulation of worms body interacted with fluid environment around it. | What is special about C. Elegans is that they are among the best understood animal. Its whole genome was sequenced and it is the only creature to have had its neural system completely simulated. It has 302 neurons hard wired with around 8000 connections. We have a complete map of C. Elegan's admittedly simple, neural circuit created by [https://http://openworm.org/ Open Worm Project] .This model has been used to implement the worm's brain in a number of ways including building an artificial version of the worm's brain and building devices seem to behave like the worm. The researches concerning how the neural system of C. Elegans uploaded to a computer to solve a problem and mimiking digital evolutionary process of C. Elegans using deep reinforcement learning in in a nature-like simulation are the main inspirations for my project. You will see details of these researches in my references and research notes section. Below is a simulation of worms body interacted with fluid environment around it. | ||
{{#ev:youtube|SaovWiZJUWY|700}} | |||
Wiliam Grey Walter's well known autonomous robot works (tortoises) was another inspiration for me. He built some of the first artificial animals in 1940s. He was a neurophysiologists and developed these robot tortoises using purely analog electronics to simulate brain process. His robots responded touch and light. | |||
{{#ev:youtube|lLULRlmXkKo|700}} | |||
===Preperation/ Design=== | ===Preperation/ Design=== |
edits