GMU:Techniken des Virtuellen/Miaomiao Ning: Difference between revisions

From Medien Wiki
 
(23 intermediate revisions by the same user not shown)
Line 7: Line 7:
HTC Vive - Virtual Reality Glasses, Unity 3D, Arduino Uno, Pulse Sensor, Bluetooth Module
HTC Vive - Virtual Reality Glasses, Unity 3D, Arduino Uno, Pulse Sensor, Bluetooth Module
<br><br>
<br><br>
Conception:<br>
'''Conception'''<br>
36 million people starved to death in the three years of the Great Chinese Famine, but any monument or memorial is forbidden in China. So I want to tell the story in virtual environment, set virtual monuments for the people dying in this period.<br>
36 million people starved to death in the three years of the Great Chinese Famine, but any monument or memorial is forbidden in China. So I want to tell the story in virtual environment, set virtual monuments for the people dying in this period.<br>
Monuments are arranged in matrix, with the data and texts chosen from a documentary literature “Tombstone” randomly (Fig. 1). When people experience the environment with a head mounted device, the monuments rotate and always face to the person (Fig. 2), which seems that the history is eager to be seen.Getting close to a certain monument, the visitor can hear someone is reading the text. At the same time, it simulates the visitor’s heart beat with the wave on the top, which reflects the mood swings.Height of the monument depends on the BPM(beat per minute) data collected from the person with pulse sensor.  
Monuments are arranged in matrix, with the data and texts chosen from a documentary literature “Tombstone” randomly (Fig. 1). When people experience the environment with a head mounted device, the monuments rotate and always face to the person (Fig. 2), which seems that the history is eager to be seen.Getting close to a certain monument, the visitor can hear someone is reading the text. At the same time, it simulates the visitor’s heart beat with the wave on the top, which reflects the mood swings.Height of the monument depends on the BPM(beat per minute) data collected from the person with pulse sensor.
[https://www.youtube.com/watch?v=MWf39UVKj_M| Videodokumentation des Projektes]
[https://www.youtube.com/watch?v=MWf39UVKj_M| Videodokumentation des Projektes]<br>
<br>
<br>
Interface:<br>
'''Interface'''<br>
Visitor wears a htc vive glasses connected with computer and running a application developed by Unity. A pulse sensor and bluetooth module are attached on the visitor’s arm with arm band, which can collect and deliver the pulse data to the computer.Then Unity get the human data and generate changes of models with script (Fig. 3).
Visitor wears a htc vive glasses connected with computer and running a application developed by Unity. A pulse sensor and bluetooth module are attached on the visitor’s arm with arm band, which can collect and deliver the pulse data to the computer.Then Unity get the human data and generate changes of models with script (Fig. 3).
<br>
<br><br>


Background:<br>
'''Background'''<br>
36 million people starved to death between 1958-1962 in china, which called The great Chinese famine. It was caused by a combination of adverse weather conditions, social pressure, economic mismanagement, and radical changes in agriculture imposed by government regulations(Collectivization of Agriculture and the Great Leap Forward). Any kind of memorials, discussion or study on the topic are forbidden in china even now.<br>
36 million people starved to death between 1958-1962 in china, which called The great Chinese famine. It was caused by a combination of adverse weather conditions, social pressure, economic mismanagement, and radical changes in agriculture imposed by government regulations(Collectivization of Agriculture and the Great Leap Forward). Any kind of memorials, discussion or study on the topic are forbidden in china even now.<br>
“Tombstone : The Untold Story of Mao's Great Famine”- first documentary book wrote by Chinese journalist Yang Jisheng, describes the event in detail and is filled with large number of shocking data collected from his field investigation and reports.<br>
“Tombstone : The Untold Story of Mao's Great Famine”- first documentary book wrote by Chinese journalist Yang Jisheng, describes the event in detail and is filled with large number of shocking data collected from his field investigation and reports.<br>
https://en.wikipedia.org/wiki/Great_Chinese_Famine/
https://en.wikipedia.org/wiki/Great_Chinese_Famine/
<br><br>
<br><br>
Technique:<br>
 
1. pulse sensor + arduino UNO board
 
'''Technique'''<br>
'''1. '''pulse sensor + arduino UNO board
[[File:pulsesensor.png|middle|600px|]]
[[File:pulsesensor.png|middle|600px|]]
<br><br>
<br><br>
Line 39: Line 42:
https://pulsesensor.com/<br>
https://pulsesensor.com/<br>
https://github.com/WorldFamousElectronics/<br>
https://github.com/WorldFamousElectronics/<br>
<br><br>
'''2.'''connect pulse sensor with Unity<br>
A test was done, in which the pulse data collected from person is used to control the angle of blocks in Unity.
[https://www.youtube.com/watch?v=RbPW2_f4YVk| Test video:Use pulse sensor in unity3D ]<br>
[[File:connect pulse sensor with Unity.png|left|230px|]]
———Unity script——————————————————————————<br>
using System.Collections;<br>
using System.Collections.Generic;<br>
using UnityEngine;<br>
using System.IO.Ports;<br>
using System.Threading;<br>
public class blockmove : MonoBehaviour {<br>
SerialPort serial = new SerialPort ("/dev/cu.usbmodem1411", 9600);<br>
void Update () {<br>
if (!serial.IsOpen)<br>
serial.Open ();<br>
int rotation = int.Parse (serial.ReadLine ());<br>
transform.localEulerAngles = new Vector3(0, rotation,0);}}<br>
———Unity script——————————————————————————<br>
<br><br>
'''3.'''realize the rotation and wave of monuments<br>
Since the pulse sensor is not so sensitive and have delay in any way, I simulate the heart beat
with sine trigonometric function.<br>
———Unity script ————————————————————————————————————————————<br>
using System.Collections;<br>
using System.Collections.Generic;<br>
using UnityEngine;<br>
public class simulatepulse : MonoBehaviour {<br>
Vector3 tempos;<br>
float amplitudeY = 0.5f;<br>
float omegaY = 2.0f;<br>
float index;<br>
void Start () {<br>
float a = Random.value; <br>
amplitudeY = amplitudeY + a;<br>
}<br>
void Update () {<br>
float x0 = transform.position.x;<br>
float z0 = transform.position.z;<br>
float camerax = Camera.main.transform.position.x;<br>
float cameraz = Camera.main.transform.position.z;<br>
float dx = camerax - x0;<br>
float dz = cameraz - z0;<br>
index += Time.deltaTime;<br>
float y = Mathf.Abs (amplitudeY*Mathf.Sin (amplitudeY+(omegaY*index)));<br>
if((Mathf.Abs(dx) < 2) & (Mathf.Abs(dz) < 2) ){<br>
transform.localScale= new Vector3(1,1,y);<br>
}<br>
———Unity script ————————————————————————————————————————————<br>
The monuments change angles and always face to the visitor.Here I use tangent trigonometric
function.<br>
———Unity script ————————————————————————————————————————————<br>
using System.Collections;<br>
using System.Collections.Generic;<br>
using UnityEngine;<br>
public class movewithcamera : MonoBehaviour {<br>
float radian ;<br>
void Start () {<br>
}<br>
void Update () {<br>
var rotationVector = transform.rotation.eulerAngles;<br>
radian = Mathf.Atan (Mathf .Abs (Camera.main.transform.position.x -<br>
transform.position.x)/Mathf .Abs (Camera.main.transform.position.z -<br>
transform.position.z));<br>
if(Camera.main.transform.position.x >transform.position.x &<br>
Camera.main.transform.position.z < transform.position.z){<br>
rotationVector.y = - (radian * 180) / Mathf.PI ;<br>
} else if(Camera.main.transform.position.x < transform.position.x &<br>
Camera.main.transform.position.z > transform.position.z){<br>
rotationVector.y = - (radian * 180) / Mathf.PI ;<br>
}else if(Camera.main.transform.position.x < transform.position.x &<br>
Camera.main.transform.position.z < transform.position.z){<br>
rotationVector.y = (radian * 180) / Mathf.PI ;<br>
}else{<br>
rotationVector.y = (radian * 180) / Mathf.PI ;<br>
}<br>
transform.rotation = Quaternion.Euler(rotationVector);<br>
}<br>
}<br>
———Unity script ————————————————————————————————————————————<br>
<br><br>
'''Some texts from “Tombstone”'''<br>
[[File:textontombstone.png|middle|600px|]]<br>
1956.1<br>
The Supreme State Conference on January 1956, passes “The Program for Agricultural Development from 1956-1967.” Mao Zedong says China will overtake the United States in steel
production.<br>
1957.11<br>
Mao leads a delegation to the International Congress of Communist and Workers’ Parties in Moscow, where he says the China will catch up with or surpass the United Kingdom in 15 years.<br>
1958.6.22<br>
Mao comments,” Surpassing the United Kingdom will not take fifteen years or seven years, but will only need two or three years, especially in still production.”<br>
1956.12<br>
96.3% percent of the peasants population has joined cooperatives, and the socialist transformation of industry and business is completed.The abolishment of private ownership and the establishment of a comprehensive planned economic system allow the state to monopolize all means of production and all means of livelihood.<br>
1957<br>
During 1957 the Anti-Rightist Movement proceeds in the cities, while the Socialist Education Movement proceeds in the countryside. Ultimately more than 600000 intellectuals are persecuted, and dissenting views are effectively eliminated.<br>
1959.1.27<br>
The Guangdong provincial party committee submits a report stating the food shortages result from “false reporting of output and private withholding by the production teams and units.”<br>
1959.2<br>
Mao writes lengthy memos on February 1959, that give rise to a nationwide campaign against “false reporting of output and private withholding.” <br>
1959.3<br>
In Jining, Shandong Province, peasants eat wheat sprouts, tree bark, and chaff. Reports find 670,000 people suffering from edea, and many deaths.<br>
1959.10<br>
A three-mouth campaign to “dig up grain and collect funds” is launched in Shan xi’s Shouyang County, during which 11,159 homes are ransacked and 3,116 people are subjected to physical abuse, resulting in at least 349 deaths.<br>
1959.10-1960.4<br>
The “Xinyang Incident”: More than 1 million people starve to death in He nan’s Xinyang Prefecture during October of 1959 to April of 1960.<br>
Winter 1959 to spring 1960<br>
The “Tongue Incident”: Gansu’s Tongwei County loses a third of its population to starvation from the winter of 1959 to the spring of 1960.<br>
1960<br>
The number of starvation deaths in the Great Famine reaches its peak in spring 1960 during the gap in food supply between the planting and harvest seasons. Known cases of the disaster include the “Zunyi Incident”( in Guizhou Province), involving massive deaths and cannibalism, and the “Luoding Incident” (in Guangdong Province), during which more than 17,000 people die within a few months.<br>
1961.4-1961.5<br>
In Guangdong Province, more than 110,000 people attempt to steal across the border to Honkong. Of the 60,000 who reach Hongkong, 40,000 are deported back to mainland China.<br>
1961 spring and summer<br>
More than 60,000 residents of the border areas of Xinjiang’s Ili Kazakh Autonomous Prefecture flee to the Soviet Union with their families, livestock, farming implements, and vehicles during spring and summer in 1961.<br>
1961.7<br>
Mao insists on maintaining a collective economy.Afterward on July 1961, at his swimming pool,Mao asks Liu Shaoqi, “Why can’t you keep things under control?” Liu retorts, “History will record the role you and I played in the starvation of so many people, and the cannibalism will also be memorialized!”<br>
I originally intended to title this book “The Road to Paradise”, but eventually changed it to “Tombstone”. I have four reasons for choosing this title : the first is to erect a tombstone for my father, who died of starvation in 1959; the second is to erect a tombstone for the 36,000,000 Chinese who deeded of starvation; and the third is to erect a tombstone for the system that brought about the Great Famine… Around 36,000,000 starvation deaths in China from 1958 to 1962. Because starvation also caused a drop in the birth rate, there was also an estimated shortfall of 40,000,000 births in China during those years.<br>
In some regions, nearly every family experienced at least one death from starvation, and some families were completely wiped out.Entire villages were left without a single living inhabitant.It was as Mao Zedong wrote in one of his poems: “ A thousand villages overgrown with weeds, men wasted away;Ten thousand homes where only ghosts sing.”<br>
How can we conceptualize the 36,000,000 people who starved to death? This number is equivalent to 450 times the number of people killed by the atomic bomb dropped on Nagasaki on August 9th, 1945… It is greater than the number of people killed in the World War I.<br>
The Great Famine even outstripped the ravages of World War II: the war caused 40 to 50 million deaths throughout Europe,Asia, and Africa over the course of seven or eight years, but the Great Famine’s 36,000,000 victims died within three or four years, with most deaths concentrated in a six-mouth period.<br>


<br clear="all" />
<br clear="all" />

Latest revision as of 12:08, 23 August 2017

Miaomiao Ning: TOMBSTONE,Memorial of the Great Chinese Famine in Virtual Reality, 2017

Tombstone.jpg


Mixed media / interaktiv
HTC Vive - Virtual Reality Glasses, Unity 3D, Arduino Uno, Pulse Sensor, Bluetooth Module

Conception
36 million people starved to death in the three years of the Great Chinese Famine, but any monument or memorial is forbidden in China. So I want to tell the story in virtual environment, set virtual monuments for the people dying in this period.
Monuments are arranged in matrix, with the data and texts chosen from a documentary literature “Tombstone” randomly (Fig. 1). When people experience the environment with a head mounted device, the monuments rotate and always face to the person (Fig. 2), which seems that the history is eager to be seen.Getting close to a certain monument, the visitor can hear someone is reading the text. At the same time, it simulates the visitor’s heart beat with the wave on the top, which reflects the mood swings.Height of the monument depends on the BPM(beat per minute) data collected from the person with pulse sensor.

Videodokumentation des Projektes

Interface
Visitor wears a htc vive glasses connected with computer and running a application developed by Unity. A pulse sensor and bluetooth module are attached on the visitor’s arm with arm band, which can collect and deliver the pulse data to the computer.Then Unity get the human data and generate changes of models with script (Fig. 3).

Background
36 million people starved to death between 1958-1962 in china, which called The great Chinese famine. It was caused by a combination of adverse weather conditions, social pressure, economic mismanagement, and radical changes in agriculture imposed by government regulations(Collectivization of Agriculture and the Great Leap Forward). Any kind of memorials, discussion or study on the topic are forbidden in china even now.
“Tombstone : The Untold Story of Mao's Great Famine”- first documentary book wrote by Chinese journalist Yang Jisheng, describes the event in detail and is filled with large number of shocking data collected from his field investigation and reports.
https://en.wikipedia.org/wiki/Great_Chinese_Famine/


Technique
1. pulse sensor + arduino UNO board Pulsesensor.png

———arduino code————————————————————————————————————————————
int PulseSensorPurplePin = 0; // Pulse Sensor PURPLE WIRE connected to ANALOG PIN 0
void setup( ) {
Serial.begin(9600); // Set's up Serial Communication at certain speed.
}
void loop( ) {
Serial.println(map(analogRead(PulseSensorPurplePin),0,600,0,360));
delay(10);
}
———arduino code————————————————————————————————————————————
source:
https://pulsesensor.com/
https://github.com/WorldFamousElectronics/



2.connect pulse sensor with Unity
A test was done, in which the pulse data collected from person is used to control the angle of blocks in Unity. Test video:Use pulse sensor in unity3D

Connect pulse sensor with Unity.png

———Unity script——————————————————————————
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using System.IO.Ports;
using System.Threading;
public class blockmove : MonoBehaviour {
SerialPort serial = new SerialPort ("/dev/cu.usbmodem1411", 9600);
void Update () {
if (!serial.IsOpen)
serial.Open ();
int rotation = int.Parse (serial.ReadLine ());
transform.localEulerAngles = new Vector3(0, rotation,0);}}
———Unity script——————————————————————————



3.realize the rotation and wave of monuments
Since the pulse sensor is not so sensitive and have delay in any way, I simulate the heart beat with sine trigonometric function.
———Unity script ————————————————————————————————————————————
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
public class simulatepulse : MonoBehaviour {
Vector3 tempos;
float amplitudeY = 0.5f;
float omegaY = 2.0f;
float index;
void Start () {
float a = Random.value;
amplitudeY = amplitudeY + a;
}
void Update () {
float x0 = transform.position.x;
float z0 = transform.position.z;
float camerax = Camera.main.transform.position.x;
float cameraz = Camera.main.transform.position.z;
float dx = camerax - x0;
float dz = cameraz - z0;
index += Time.deltaTime;
float y = Mathf.Abs (amplitudeY*Mathf.Sin (amplitudeY+(omegaY*index)));
if((Mathf.Abs(dx) < 2) & (Mathf.Abs(dz) < 2) ){
transform.localScale= new Vector3(1,1,y);
}
———Unity script ————————————————————————————————————————————


The monuments change angles and always face to the visitor.Here I use tangent trigonometric function.


———Unity script ————————————————————————————————————————————
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
public class movewithcamera : MonoBehaviour {
float radian ;
void Start () {
}
void Update () {
var rotationVector = transform.rotation.eulerAngles;
radian = Mathf.Atan (Mathf .Abs (Camera.main.transform.position.x -
transform.position.x)/Mathf .Abs (Camera.main.transform.position.z -
transform.position.z));
if(Camera.main.transform.position.x >transform.position.x &
Camera.main.transform.position.z < transform.position.z){
rotationVector.y = - (radian * 180) / Mathf.PI ;
} else if(Camera.main.transform.position.x < transform.position.x &
Camera.main.transform.position.z > transform.position.z){
rotationVector.y = - (radian * 180) / Mathf.PI ;
}else if(Camera.main.transform.position.x < transform.position.x &
Camera.main.transform.position.z < transform.position.z){
rotationVector.y = (radian * 180) / Mathf.PI ;
}else{
rotationVector.y = (radian * 180) / Mathf.PI ;
}
transform.rotation = Quaternion.Euler(rotationVector);
}
}
———Unity script ————————————————————————————————————————————



Some texts from “Tombstone”
Textontombstone.png
1956.1
The Supreme State Conference on January 1956, passes “The Program for Agricultural Development from 1956-1967.” Mao Zedong says China will overtake the United States in steel production.
1957.11
Mao leads a delegation to the International Congress of Communist and Workers’ Parties in Moscow, where he says the China will catch up with or surpass the United Kingdom in 15 years.
1958.6.22
Mao comments,” Surpassing the United Kingdom will not take fifteen years or seven years, but will only need two or three years, especially in still production.”
1956.12
96.3% percent of the peasants population has joined cooperatives, and the socialist transformation of industry and business is completed.The abolishment of private ownership and the establishment of a comprehensive planned economic system allow the state to monopolize all means of production and all means of livelihood.
1957
During 1957 the Anti-Rightist Movement proceeds in the cities, while the Socialist Education Movement proceeds in the countryside. Ultimately more than 600000 intellectuals are persecuted, and dissenting views are effectively eliminated.
1959.1.27
The Guangdong provincial party committee submits a report stating the food shortages result from “false reporting of output and private withholding by the production teams and units.”
1959.2
Mao writes lengthy memos on February 1959, that give rise to a nationwide campaign against “false reporting of output and private withholding.”
1959.3
In Jining, Shandong Province, peasants eat wheat sprouts, tree bark, and chaff. Reports find 670,000 people suffering from edea, and many deaths.
1959.10
A three-mouth campaign to “dig up grain and collect funds” is launched in Shan xi’s Shouyang County, during which 11,159 homes are ransacked and 3,116 people are subjected to physical abuse, resulting in at least 349 deaths.
1959.10-1960.4
The “Xinyang Incident”: More than 1 million people starve to death in He nan’s Xinyang Prefecture during October of 1959 to April of 1960.
Winter 1959 to spring 1960
The “Tongue Incident”: Gansu’s Tongwei County loses a third of its population to starvation from the winter of 1959 to the spring of 1960.
1960
The number of starvation deaths in the Great Famine reaches its peak in spring 1960 during the gap in food supply between the planting and harvest seasons. Known cases of the disaster include the “Zunyi Incident”( in Guizhou Province), involving massive deaths and cannibalism, and the “Luoding Incident” (in Guangdong Province), during which more than 17,000 people die within a few months.
1961.4-1961.5
In Guangdong Province, more than 110,000 people attempt to steal across the border to Honkong. Of the 60,000 who reach Hongkong, 40,000 are deported back to mainland China.
1961 spring and summer
More than 60,000 residents of the border areas of Xinjiang’s Ili Kazakh Autonomous Prefecture flee to the Soviet Union with their families, livestock, farming implements, and vehicles during spring and summer in 1961.
1961.7
Mao insists on maintaining a collective economy.Afterward on July 1961, at his swimming pool,Mao asks Liu Shaoqi, “Why can’t you keep things under control?” Liu retorts, “History will record the role you and I played in the starvation of so many people, and the cannibalism will also be memorialized!”
I originally intended to title this book “The Road to Paradise”, but eventually changed it to “Tombstone”. I have four reasons for choosing this title : the first is to erect a tombstone for my father, who died of starvation in 1959; the second is to erect a tombstone for the 36,000,000 Chinese who deeded of starvation; and the third is to erect a tombstone for the system that brought about the Great Famine… Around 36,000,000 starvation deaths in China from 1958 to 1962. Because starvation also caused a drop in the birth rate, there was also an estimated shortfall of 40,000,000 births in China during those years.
In some regions, nearly every family experienced at least one death from starvation, and some families were completely wiped out.Entire villages were left without a single living inhabitant.It was as Mao Zedong wrote in one of his poems: “ A thousand villages overgrown with weeds, men wasted away;Ten thousand homes where only ghosts sing.”
How can we conceptualize the 36,000,000 people who starved to death? This number is equivalent to 450 times the number of people killed by the atomic bomb dropped on Nagasaki on August 9th, 1945… It is greater than the number of people killed in the World War I.
The Great Famine even outstripped the ravages of World War II: the war caused 40 to 50 million deaths throughout Europe,Asia, and Africa over the course of seven or eight years, but the Great Famine’s 36,000,000 victims died within three or four years, with most deaths concentrated in a six-mouth period.