Hyperplane Lab was founded by Dr. Hao Dong in 2019 at Peking University, focusing on deep/machine learning, computer vision and robotics. Our goal is to reduce the data required for learning intelligent systems. The current topics include:
 

• Unsupervised World Modelling: learning the representation of the world
• Generative + Reinforcement Learning: learning to interact with the world
• Generative + Computer Vision: learning to see the world

For more information, please visit: https://zsdonghao.github.io/

MEMBERS

            Hao Dong

RESEARCH PROJECTS

1. Unsupervised World Modelling

Enabling machines to understand the world in human-like approaches in an important topic in AI and cognitive science. Interactive environments include controllable agent and other objects; we achieve an action-label free approach to model the interaction between the agent and the physical environment, enabling action-based visual forecasting.

Specifically, humans are talented at modelling the real-world physical environment from visual observations. The environment is driven forward by the control of the agent and the interaction between the agent and the environment. By observing an agent interacting with the environment, humans develop senses of interaction laws in the environment, thus acquiring the ability to control the agent and predict events happen in the future, which helps them to make decisions and perform actions.

For example, one of our research studies the problem of modelling the environment. Although existing methods achieve impressive results training with action supervision, environment modelling from only visual observations still remains challenging. One of our study proposes an end-to-end method that learns to identify the agent within a deterministic environment using only visual observations (videos) as the training data. Then, for each action, only one demonstration that shows the transition caused by the action is applied to model the interaction between the agent and environment.

2. Generative + Computer Vision

Controllable data generation is important to computer vision and machine learning. We study how to use less supervision to achieve various generative tasks, such as unsupervised image-to-image translation and natural language image manipulation. Those researches are important to both domain adaptation and generation models.

For example, one of our study disentangles the semantic information from the two modalities (image and text) and generate new images from the combined semantics. Another study proposes a new method to replace cycle loss and successfully perform geometric changes, remove large objects, or ignore irrelevant texture.

3. Digital Healthcare

For health care, we study how to use less data and low-cost sensors to achieve better diagnostic performance. Our researches reduce the scanning time of MRI, reduce the data required for tumour segmentation and sleep scoring. Specifically, we design new algorithms for MRI reconstruction and new algorithms for MRI tumor segmentation. Apart from medical imaging, we also have research related to other data modality. For example, another previous direction designs new soft material and electrode for in-the-ear EEG recoding and single-channel EEG analysis method for low-cost sleep stage scoring.