UM EECS 598: Action and Perception, Winter 2023

Instructors: Stella Yu, Benjamin Kuipers, Andrew Owens

Assistants: Zilin Wang, Sangryul Jeon

#	Date	Papers	Slides
0	01/04/2023		Introduction
1	01/09/2023	1994 A Critique of Pure Vision 2018 Deep Learning: A Critical Appraisal	1994PureVisionSlides 2018DLAppraisalSlides
2	01/11/2023	2009 The Interface Theory of Perception 2017 Shakey: From Conception to History	2009InterfaceTheorySlides 2017ShakeySlides (discussion only)
	01/16/2023	MLK Holiday
3	01/18/2023	2019 Vision, an Optical User Interface 2021 The Language of Vision	2019OpticalInterfaceSlides 2021LanguageVisionSlides
4	01/23/2023	1978 Principles of Categorization 2002 Big Book of Concepts Chapter 3	1978CategorizationSlides 2002ConceptsSlides
5	01/25/2023	1979 The Theory of Affordances (Chapter 8) 2019 Putting Humans in a Scene: Learning Affordance in 3D Indoor Environments	1979AffordanceSlides 2019Affordance3DSlides
6	01/30/2023	1988 Exploratory Behavior in the Development of Perceiving, Acting, and the Acquiring of Knowledge 2019 An Ecological Approach to Learning in (Not and) Development	1988ExploratoryBehaviorSlides 2019LearningInDevelopmentSlides
7	02/01/2023	1994 Initial Knowledge: 6 Suggestions 2001 A Sensori-motor Account of Vision and Visual Consciousness	1994InitialKnowledgeSlides 2001SensorimotorAccountSlides
8	02/06/2023	2007 Intrinsic Motivation Systems for Autonomous Mental Development 2013 Information-seeking, Curiosity, and Attention: Computational and Neural Mechanisms	2007IntrinsicMotivationSlides 2013InfomationSeekingSlides
9	02/08/2023	2017 Curiosity-driven Exploration by Self-supervised Prediction 2017 Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks	2017CuriosityDrivenSlides 2017MAMLSlides
10	02/13/2023	2003 Perception of the Structure of the Physical World Using Unknown Multimodal Sensors and Effectors 2020 A Formal Account of Structuring Motor Actions With Sensory Prediction for a Naive Agent	2003UnknownMultimodalSlides 2020MotorActionSlides
11	02/15/2023	2012 Object Individuation and Physical Reasoning in Infancy: An Integrative Account 2021 The Emergence of Objectness: Learning Zero-Shot Segmentation from Videos	2012ObjectIndividuationSlides 2021EmergenceObjectnessSlides
12	02/20/2023	2016 The Roles of Vision and Eye Movements in the Control of Activities of Daily Living 2018 The Developing Infant Creates a Curriculum for Statistical Learning	2016EyeMovementSlides 2018DevelopingInfantsSlides
13	02/22/2023	1987 Hand Movements: A Window into Haptic Object Recognition 2006 Control Strategies in Object Manipulation Tasks	1987HandMovementsSlides 2006ObjectManipulationSlides
	02/24/2023	Project proposal due at 11:59 pm EST
	02/27/2023	Winter Vacation
	03/01/2023	Winter Vacation
14	03/06/2023	1989 A Robot That Walks; Emergent Behaviors from A Carefully Evolved Network 2010 The iCub Humanoid Robot: An Open-systems Platform for Research in Cognitive Development	1989RobotThatWalksSlides 2010ICubRobotSlides
15	03/08/2023	1999 Internal Models for Motor Control and Trajectory Planning 2020 Learning Quadrupedal Locomotion over Challenging Terrain	1999InternalModelsSlides 2020QuadrupedalLocomotionSlides
16	03/13/2023	2021 How to Train Your Robot with Deep Reinforcement Learning: Lessons We Have Learned 2018 Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Control	2021TrainRobotRLSlides 2018VisualForesightSlides
17	03/15/2023	2021 RMA: Rapid Motor Adaptation for Legged Robots 2023 Learning Visual Locomotion with Cross-Modal Supervision	2021RMASlides 2023VisionRMASlides
18	03/20/2023	2015 Motor Development 2020 Infant Object Manipulation and Play	2015MotorDevelopmentSlides 2020InfantObjManipulationSlides
19	03/22/2023	2020 Deep Learning Can Accelerate Grasp-optimized Motion Planning 2021 A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms	2020GraspOptimizedMotionPlanSlides 2021ReviewRobotLearningSlides
20	03/27/2023	2018 Learning to Grasp by Extending the Peri-personal Space Graph	2018LearningToGraspSlides
21	03/29/2023	2017 Time-Contrastive Networks: Self-Supervised Learning from Video 2023 VideoDex: Learning Dexterity from Internet Videos	2017TCNSlides 2023VideoDexSlides
22	04/03/2023	2004 Tools for the Body (Schema) 2010 Body Schema in Robotics: A Review	2004ToolsForTheBodySlides 2010BodySchemaReviewSlides
23	04/05/2023	2011 A New Neural Framework for Visuospatial Processing	2011VisuospatialProcessingSlides
24	04/10/2023	2022 Deep Learning Approaches to Grasp Synthesis: A Review 2018 More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch	2022GraspSynthesisReviewSlides 2018MoreThanAFeelingSlides
25	04/12/2023	2016 RL^2: Fast Reinforcement Learning via Slow Reinforcement Learning 2018 Modular Meta-learning	2016RL2Slides 2018ModularMetaLearningSlides
26	04/17/2023	2022 Navigating to Objects in the Real World 2005 The Development of Embodied Cognition: Six Lessons from Babies	2022NavigateToObjectsSlides 2005EmbodiedCognitionSlides
	04/25/2023	Project write-up and slides due at 11:59 pm EST
	04/26/2023	Project presentation at EECS1303 10:30am - 12:30pm EST	Examples: CuriosityDrivenExploration Disambiguation HumanEyeInspiredRNN InvestigatingObjectness LearningByLooking ToddlerNet