Home Overview Research News People Contacts
navigation bar
 
Center for Neuromorphic Systems Engineering
Research 2001-2002: All Projects
Below is a listing of all projects currently being investigated by members of the CNSE. They are organized alphabetically by first author. Click on full report to go to detailed report; click on author name to go to home page (or email).
 

Labor Division and Distributed Sensing in Swarm Systems
William Agassounon, Alcherio Martinoli
Collaborators: Robert McEliece (Caltech), Erik Antonsson (Caltech), David H. Lewis (TRW), Willy Behrens (TRW), Guy Theraulaz (CNRS, Toulouse, France), Deborah Gordon (Stanford), Jean-Louis Deneubourg (ULB, Bruxelles, Belgium).

This research project aims to devise distributed scalable control algorithms for division of labor and task allocation in mobile embedded swarm systems. Our approach is inspired by social insect societies (ants, bees, termites, etc) whose collective behavior often emerges from a series of local agent-to-agent and agent-to-environment interactions. We are currently developing response threshold-based algorithms to achieve efficient and robust division of labor, and probabilistic models that provide accurate forecast of the resulting collective behavior. These swarm systems are therefore analyzed at several implementation levels, from macroscopic and microscopic probabilistic models to real robot experiments through embodied sensor-based simulations. (full report)



VLSI For Feature Detection and Tracking
Christophe Basset, Bedabrata Pain (JPL), Pietro Perona

We are developing an integrated visual tracking system. The goal of this collaborative work with the Jet Propulsion Laboratory is a single chip serving as a camera (1024x1024 pixels imager array) able to find and track a small (7x7 pixels) target whose image has previously been provided by the user. (full report)



Configurable Architectures, Systems and Tools for Real-Time Low-level Vision
Arrigo Benedetti, Pietro Perona

The long-term goal of this project is to build an infrastructure for the design and implementation of real-time computer vision systems. Since vision algorithms are compute-bound we have chosen the technology of Field Programmable Gate Array (FPGAs), that allow to exploit the instruction level parallelism inherent to the first stages of vision tasks. The first problem that we have considered is the real-time computation of the optical flow measured from the sequence of images captured by a video camera. We have designed, built and demonstrated a system able to select in real-time 2-D visual features on a commercially available reconfigurable platform. During this process we have learned that the system level architectures of off-the-shelf reconfigurable computers are not optimized for low level vision tasks, therefore, we have designed a novel architecture dedicated to real-time processing of video streams. A system based on this architecture has been built and is currently being tested. More recently, we have studied the problem of bit-width computation for the optimization of the data paths found in digital video signal processors. (full report)


Weighted Feature matching Algorithms for Mobile Robot Displacement Estimation
Dr. Joel W. Burdick, Dr. Stergios Roumeliotis, Kristo Kriechbaum, Sam Pfister

Sensor based motion planning is an integral part of mobile robotics. It incorporates sensor information, reflecting the current state of the environment, into a robot's planning process, as opposed to classical planning , where full knowledge of the world's geometry is assumed to be known prior to the planning event. Sensor based planning is important because: (1) the robot often has no a priori knowledge of the world; (2) the robot may have only a coarse knowledge of the world because of limited memory; (3) the world model is bound to contain inaccuracies which can be overcome with sensor based planning strategies; and (4) the world is subject to unexpected occurrences or rapidly changing situations.
(full report)



Distributed Collective Building of Two-Dimensional Structures Using Autonomous Robots
Kjerstin Easton, Alcherio Martinoli
Collaborators: Joel Burdick (CNSE, Caltech), Guy Theraulaz (CNRS, Toulouse, France), Dario Floreano (EPFL, Lausanne, Switzerland), Nicolas Reeves (UQAM, Montreal, Canada)

Using autonomous robots to build three-dimensional structures is a distant goal, but the first step in approaching collective building is to construct two-dimensional architectures. Using a team of miniature Khepera robots with manipulation and vision capabilities, we will implement a building technique modeled after qualitative stigmergic construction mechanisms used by social insects. This technique will allow the robots to communicate building instructions through modifications to the local environment, avoiding dependence on explicit robot-to-robot communication and lending itself to implementation with any number of robots. (full report)


Human Neural Activity during Learning and Memory
Jessica Edwards, Miguel Remondes, Adam Mamelak

While learning and memory are widely studied in a variety of systems, it is still rare to be able to examine these behaviors at the single cell level in humans. Working with a group of epileptic patients, we are able to record from individual neurons in alert and learning humans. Patients suffering from medically intractable epilepsy are resistant to drug therapies that are traditionally used for seizure control. Resection of the epileptogenic focus provides seizure relief. To localize the area for surgery, patients are implanted with up to twenty electrodes, including microwire, hybrid electrodes in the hippocampus and amygdala. The duration of the medical procedures allows us to monitor the electrical activity of cells in the hippocampus and amygdala for up to one week. Using a battery of neuropsychological tests, we are able to examine rapid learning and declarative memory. Tests we are currently using include three versions of the Recognition Memory Task: Faces, Objects and Words, a Continuous Visual Memory Task, Verbal Paired Associates and a variation of the Taylor picture task. We also use a virtual Water Maze, a joystick-operated simulation of the Morris Water Maze task, to test object-cued place memory. We hope to add several emotional memory tasks as well as a version of the memory game "Concentration" in the upcoming months. Currently, we are beginning to analyze data that may demonstrate a direct relationship between hippocampal activity and memory formation in humans. Further, we hope to examine the correlation between local field potentials (EEG) and single-unit activity.



Human Action Classification
Xiaolin Feng, Pietro Perona

We study and classify the human actions in this project. We first construct a large dataset of movelets which are defined as body configuration and motion. Each action is represented as the temporal link through the movelets and this temporal link is modeled by Hidden Markov Model. For a given test sequence, the likelihood that it fits the actions we learnt are estimated. The sequence is classified to the action with the maximum likelihood. The algorithm is tested on both periodic (walking, jogging etc.) and nonperiodic (reaching) human actions.
(full report)



Classification of Road Vehicles
Robert Fergus, Bradley Phillips, Paul Updike

We have worked to apply the probabilistic recognition techniques developed in our lab to the classification of road vehicles in busy traffic scenes. We have demonstrated that the model can successfully determine the presence or absence of cars in a given road scene using a detection algorithm that is translation and scale invariant, and can deal with cluttered scenes and occlusions. (full report)


A Thermopneumatic Microfluidic System
Charles Grosjean, Xing Yang, and Yu-Chong Tai

A self-contained planar microfluidic system using thermopneumatic actuation has been demonstrated. Using a novel suspended silicon island heater fabricated by DRIE, and a precision machined acrylic fluidic substrate with a matching silicone rubber membrane, a system of channels, valves, and a pump has been demonstrated with self-contained actuation using air as a working fluid. (full report)


Attention as a Result of Distributed Competition.
Fred H. Hamker

Recordings in V4, IT, MT, MST, PFC and FEF reveal influences of attention on the average rate activity of neurons. However, it is still missing a global picture of the process of attention, i.e. the origin of spatial attention and the interactions between feature-based and spatial attention. We investigate the possibility of a spatial stimulus reentry from the frontal eye field into extrastriate visual areas by means of a quantitative comparison between simulations and experimental data. (full report)


Mapping Contingency Awareness in Fear Conditioning
C.J. Han

The goal of this project is to employ two types of Pavlovian conditioning: trace and delay, to investigate the awareness of the contingency of the conditioned stimulus (CS) and unconditioned stimulus (US). We have successfully established the behavioral and molecular paradigms over the past year and are currently collecting data of the effects of the anterior cingulate cortex lesion and the immediate early gene c-fos expression patterns in the mouse brain. (full report)


Ultra Low-power Concurrent Transceiver Architectures for Ubiquitous Networks
H. Hashemi and A. Hajimiri

We are proposing a completely new approach to design Ultra-Low Power Concurrent Multiband Transceivers capable of operating at multiple frequency bands simultaneously with minimal overhead to the system resources for a network of sensors. (full report)


Distributed Plume Tracing
Adam Hayes, Alcherio Martinoli
Collaborators: Rodney Goodman, Michael Freund, Nate Lewis
External Collaborators: Owen Holland

The objective of this project is to study biologically inspired algorithms which enable a robot or group of robots to track an odor plume to its source, with an appropriate combination of speed, efficiency, reliability, and accuracy. Research is conducted at three levels: non-embodied point simulations, embodied sensor-based simulations, and real robots. The simulations use sensors and actuators which are based on the capabilities of the real robots, and plume information is derived from empirical data files recorded from real plumes or realistic plume simulators. In simulation we explore the performance of various families of simple algorithms, as well as the potential for automated parameter tuning and on-line learning. We assess the most promising algorithms on real robots, which are equipped with Caltech olfactory sensors, anemometric devices, and simple communication systems. (full report)


Flocking in Embedded Robotic Systems
Adam Hayes, Ian Kelly, Alcherio Martinoli
Caltech Collaborators: Richard Murray

The goal of this project is to implement flocking behavior on real robots, and then study the system to determine what sensory information and behaviors are most important to robust flocking. Our algorithms are inspired by those of Reynolds and Brogan and Hodgins, and are specifically adapted to the sensory and motor constraints of a real robotic platform. Work is ongoing using a sensor-based simulator, Webots, as well as our Moorebot fleet using the overhead camera to emulate additional sensory input. We are in the process of developing sensory hardware for the Moorebots so that they may flock autonomously. (full report)


Rapid Natural Scene Categorization without Attention
Fei Fei Li, Rufin VanRullen, Christof Koch, Pietro Perona

Visual attention plays an important role as we walk around the world and recognizes different objects. So what happens when attention is taken away? Are we still able to recognize scenes or objects? Our study finds that certain high level tasks, such as natural scene categorization, can still be performed with little or no attention. (full report)


Distributed Learning in Swarm Systems
Ling Li, Alcherio Martinoli, Yaser Abu-Mostafa

Distributed learning is the learning process of multiple autonomous agents in a varying environment, where each agent may have only partial information about the environment and other agents. We model the system and individual agents, then use several techniques such as reinforcement learning to find the optimal strategy for each agent in order to maximize the group performance. Our experiments with the stick-pulling problem showed agents became specialized automatically.
(full report)


Holographic Imaging of Biological Samples
Wenhai Liu, Jose Mumbru, Demetri Psaltis

We are developing an imaging system with the ability of imaging a 3-D object plus its color spectrum information. The system makes use of the spatial and wavelength selectivity of volume holograms, which act as multiple focal-length lenses and color filters to separate 2-D slices with different color from the 3-D object into various detectors. The holographic microscope will be a powerful tool for imaging application in cell-biology, biochemistry, materials research and any other 3-D imaging application. (full report)


Fast Holographic Recording Using Angle Multiplexing
Zhiwen Liu, Gregory J. Steckman and Demetri Psaltis

We demonstrate a holographic system which can record nanosecond events. Five frames of laser induced shock wave propagation were recorded using this apparatus with a time resolution of 5.9ns and frame interval of 12ns.
(full report)


The Neuroethology of Sensory-Based Behavior
Dr. Malcolm MacIver, Prof. Joel Burdick

We have begun research that addresses the interrelationship between animal sensing and the mechanics of animal movement. There are two interrelated thrusts to this work. The first is optimal sensing and movement strategies for far-field targets, such as distant resources that must be detected and acquired. The second thrust is optimal sensing and movement strategies for near-field locomotion-directed signals, such as needed for sensing flow velocity near a constriction in a streambed that requires a fish to increase its thrust.
(full report)


Sensing and Control for Robotic Fish Locomotion
Richard Mason, Kristi Morgansen, Joel Burdick

We are studying issues in fluid mechanics, nonlinear control, and sensing that are necessary for the development of self-propelled robot fish. (full report)


A Mems Body Fluid Flow Sensor
Ellis Meng, Sascha Gassmann, and Yu-Chong Tai

To achieve in vitro flow rate measurements of biological fluids in such tasks as hematological studies and urinalysis, a MEMS flow sensor has been developed. Flow sensing is achieved by measuring the forced convective heat transfer from a thermal sensing element to the fluid. Currently, fluid flow down to 10 ml/min can be detected. (full report)


Modeling Reverse-PHI Motion Selective Neurons In Cortex: Double Synaptic Veto Mechanism
Chunhui Mo, C. Koch

Reverse-phi motion is the illusory reversal of perceived direction of movement when the stimulus contrast is reversed in successive frames. Here we proposed a double synaptic veto mechanism that could account for experimental observed responses to reverse-phi motion in V1 cells. We carried out detailed biophysical simulation in NEURON and verified our results with experimental data. (full report)


Optically Programmable FPGA Systems
Jose Mumbru, George Panotopoulos, Arrigo Benedetti, Demetri Psaltis, Pietro Perona Industrial Collaborators: Holoplex, Honeywell, Photobit

The aim of this project is to investigate and demonstrate a Parallel Optical Interface between a Holographic Memory and a Silicon Circuit. This interface is implemented as an Optical Programmable Gate Array (OPGA), which is an enhanced version of a conventional FPGA, utilizing a holographic memory accessed by an array of VCSELs to program its logic. Combining spatial and shift multiplexing to store the configuration pages in the memory, the OPGA module is very compact and has extremely short configuration time allowing for dynamic reconfiguration. The reconfiguration capability of the OPGA can be applied to solve more efficiently problems in pattern recognition and searches in databases. The silicon hardware used for the OPGA can also be interfaced to a Holographic Disk Database and used for fast searches in the stored data.
(full report)


Distributed Manipulation
Todd Murphey, Joel W. Burdick

This research analyzes the stability of distributed manipulation control schemes. A commonly proposed method for designing a distributed actuator array control scheme assumes that the system's control action can be approximated by a continuous vector force field. The continuous control vector field idealization must then be adapted to the physical actuator array. However, we have shown that when one takes into account the discreteness of actuator arrays and realistic models of the actuator/object contact mechanics, the controls designed by the continuous approximation approach can be unstable. For this analysis we introduce and use a ``power dissipation'' method that captures the contact mechanics in a general but tractable way. We show that the quasi-static contact equations have the form of a multi-model hybrid system. We introduce a discontinuous feedback law can produce stability which is robust with respect to variations in contact state. (full report)



A Priori Training Data Valuation
Alexander Nicholson, Yaser Abu-Mostafa

For machine learning it is generally accepted that a greater amount of available data facilitates improved generalization. In practice, however, a learning algorithm cannot accomodate and unlimited data set and may be hindered by noisy and irregular data. We introduce a procedure for evaluating individual training examples. This valuation can serve as a basis for selecting training sets of limited size and for detecting outliers or other undesirable data. We demonstrate that learning with a data set from which the worst data has been removed can result in improved generalization performance. (full report)




The Bin Model for Generalization
Alexander Nicholson, Xubo Song, Yaser Abu-Mostafa

The problem of overfitting the data is attacked by using the Bin Model analysis. This provides a method of bounding generalization error without sacrificing valuable training data. (full report)

 

Gesture Recognition
George Panotopoulos, Dinkar Gupta, Demetri Psaltis, Pietro Perona

Though your personal computer has a processing capacity orders of magnitude larger than it did some ten years ago you still use the same means to interface with it, namely a keyboard and pointing device. In the context of this project we investigate the design of an interface based on human gestures. The system we are envisioning is not limited to a particular user and should be able to learn new gestures.
(full report)



Models of Visual Object Categorization In Humans
Robert J. Peters, Fabrizio Gabbiani, Christof Koch

Previous studies of exemplar, prototype, and decision-bound models of visual object categorization have not resolved the importance of memory capacity and flexibility of decision surfaces in human categorization behavior. We have compared these previous models with our new roaming exemplar model (RXM), according to their abilities to match human observers' categorizations of various 2-D image contours. Unlike past comparisons among categorization models, we explicitly accounted for memory capacity by penalizing models for their number of free parameters with the Akaike information criterion. This revealed that a successful model of human categorization--such as the RXM--did not require a large memory capacity if the orientation of its decision boundary was unconstrained, suggesting that an efficient computer implementation of object categorization could also rely on limited memory storage. (full report)



Flexible Parylene-Valved Skin for Adaptive Flow Control
T. Nick Pornsin-Sirirak, Matthieu Liger, Yu-Chong Tai, Steve Ho, Chih-Ming Ho

This research describes the first work of using wafer-sized flexible parylene-valved actuator skin (total thickness ~ 20 _m) for micro adaptive flow control. The check-valved actuator skin features vent-through holes with tethered valve caps on the membrane to regulate pressure distribution across the skin. The skins were integrated onto micro-aerial-vehicle (MAV) wings that were tested in the wind tunnel for aerodynamic evaluation. The test result has shown a very significant effect on the aerodynamic performance. Compare to the reference wings (no actuators), both the lift and thrust of the check-valved wings are improved by more than 50%. This is the first experimental result to demonstrate that the application of MEMS actuator skins for flow control is very promising. (full report)



Structural Description of Basic Objects With Features
Christoph Rasche

We explore the representation of basic-level categories using computer vision methods. The category representation is expressed by lines, arcs and a combination thereof. In a bottom-up process we extract such features, in a top-down process we try to match each category representation against the bottom-up output. (full report)



Attention Modulation of Visually Responsive Neurons in the Human Medical Temporal Lobe.
Leila Reddy, Patrick Wilken, Christof Koch

Previous work from our laboratory (Kreiman et al.,2000) has shown that neurons in the medical temporal lobe structures are visually responsive to categories of images. We intend to test whether attention modulates cell firing in these neurons.
(full report)



Face-gender Discrimination Modulated by Attentional Load
Leila Reddy, Patrick Wilken, Christof Koch

This experiment demonstrates that performance in gender discrimination tasks is compromised when attention is engaged by another attentionally demanding task. However, performance is still highly above chance implying that in the near absence of attention, observers can still distinguish the gender of a face to some extent. (full report)

 



Shadow Carving
Silvio Savarese, Holly Rushmeier, Fausto Bernardini, Pietro Perona

The shape of an object may be estimated by observing the shadows on its surface. Assuming that a conservative estimate of the object shape is available, our method analyzes images of the object illuminated with known point light sources and taken from known camera locations. The surface estimate is adjusted using the shadow regions to produce a refinement that is still a conservative estimate. A proof of correctness is provided. The method has been tested and validated with experimental results. (full report)


Detection of Human Motion in a Cluttered Scene
Yang Song, Luis Goncalves, and Pietro Perona

Humans are the most important component of a machine's environment. We develop an algorithm which can generate models of human motion automatically from unlabeled real image sequences. Experiments show that the resulting models can successfully detect and label humans from image sequences with clutter and occlusion. (full report)




Attentional Modulation of Visual Motion Perception Using Novel Wavelet Stimuli Ð Combination Study of Psychophysics and fMRI Imaging
N. Tsuchiya, G. Rees, J. Braun & C. Koch

We have previously characterized the effects of withdrawing attention on detection and discrimination of static visual stimuli (Lee et al. Nat Neuro 1998). Here we report attentional modulation of motion perception in psychophysics experiment. A novel motion stimulus comprising spatio-temporally contrast-modulated Gabor wavelets was used to distinguish attentional effects on mechanisms sensitive to component motion from those sensitive to pattern motion (Schrater et al Nat Neuro 2000). In the second experiment, we confirmed our component stimulus only activates only early visual cortex by functioal magnetic resonance imaging (fMRI) measurement, supporting our argument in psychophysics and consistent with our previous result (Rees et al. Nat Neuro 2000). (full report)


Part 1/ Rapid Visual Categorization In The Absence of Awareness
Part 2/ Processing Capacity For Natural Scenes and Objects in the Human Visual System
Rufin VanRullen

Humans can categorize natural scenes on the basis of the presence of a target object (i.e. animal) so rapidly (150 ms) that such processing has been proposed to rely on the feed-forward propagation of information collected during the first milliseconds of visual stimulation. According to this view, early motor responses should be mostly unaffected by masking the visual stimulus after a few tens of milliseconds. We asked our subjects to respond to masked (SOA 26.6 ms) and unmasked natural scenes when they contained an animal. (full report)



Primitives for Human Motion: A Dynamical Approach
D. Del Vecchio, R.M. Murray, P. Perona

Using tools from d dynamical systems theory and systems identification theory we develop the study of primitives for human motion which we refer to as movemes. We introduce basic definitions of dynamical independence of LTI systems and segmentability of signals and we develop classification and segmentation algorithms for two dimensional motions. We test our ideas on data sampled from four human subjects who were engaged in a simple real­life activity including two movemes. Our experiments show that we are able to distinguish between the two movemes and recognize them even when they take place in an activity containing more than one moveme.
(full Report)



Towards an Integrated Model of Saliency-based Attention and Object Recognition
Dirk Walther, Maximilian Riesenhuber, Tomaso Poggio, Laurent Itti, Christof Koch

We are working on an integrated model for the dorsal (where) and the ventral (what) pathway in the primate's visual processing system and the interaction between these two pathways. The model will be applied to visual search tasks for detecting objects in cluttered natural scenes. Components of top-down attention will be integrated into the system to achieve this goal. (full report)



Underwater Shear Stress Sensor
Yong Xu, Fukang Jiang, Qiao Lin, Jason Clendenen, Steve Tung and Yu-Chong Tai

A micromachined, vacuum-cavity insulated, thermal shear stress sensor is developed for underwater applications. The two major challenges for underwater application, namely the waterproof coating and pressure sensitivity, are specially studied for our device. (full report)


Swarm Intelligence and Traffic Safety
Yizhen Zhang, Alcherio Martinoli
Collaborators: Erik Antonsson (Caltech), Ross Olney (Delphi-Delco Automotive Systems)

A smart car that assists the driver must give warnings in dangerous situations, override the driver to avoid collisions, and help to reach the intended destination as quickly as possible. Unfortunately, satisfying these requirements and at the same time leaving the decisional autonomy at the individual level becomes an extremely hard problem to solve with traditional methods. Biologically-inspired techniques such as Swarm Intelligence and Incremental Evolution provide new promising ways to tackle the design and distributed control problems of a traffic system. In this project, solutions are developed using embodied simulations and validated with real robot experiments. (full report)




[top]

 
   

__________________________________________________
Home | Overview | Research | News | People | Contacts
Calendar of Events | Education and Outreach | Industrial Interactions | Strategic Plan
| NESS

last modified: 2/22/07