Skip to main content
SpringerLink
Log in

Physics-based virtual reality for task learning and intelligent disassembly planning

  • SI: Manufacturing and Construction
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Physics-based simulation is increasingly important in virtual manufacturing for product assembly and disassembly operations. This work explores potential benefits of physics-based modeling for automatic learning of assembly tasks and for intelligent disassembly planning in desktop virtual reality. The paper shows how realistic physical animation of manipulation tasks can be exploited for learning sequential constraints from user demonstrations. In particular, a method is proposed where information about physical interaction is used to discover task precedences and to reason about task similarities. A second contribution of the paper is the application of physics-based modeling to the problem of disassembly sequence planning. A novel approach is described to find all physically admissible subassemblies in which a set of rigid objects can be disassembled. Moreover, efficient strategies are presented aimed at reducing the computational time required for automatic disassembly planning. The proposed strategies take into account precedence relations arising from user assembly demonstrations as well as geometrical clustering. A motion planning technique has also been developed to generate non-destructive disassembly paths in a query-based approach. Experiments have been performed in an interactive virtual environment including a dataglove and motion tracker that allows realistic object manipulation and grasping.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  • Aguinaga I, Borro D, Matey L (2008) Parallel RRT-based path planning for selective disassembly planning. Intl J Adv Manuf Technol 36:1221–1233

    Article  Google Scholar 

  • Aleotti J, Caselli S (2007) Robot grasp synthesis from virtual demonstration and topology-preserving environment reconstruction. In: IEEE/RSJ international conference on intelligent robots and systems, (IROS), San Diego, USA

  • Aleotti J, Caselli S (2009) On the potential of physics-based animation for task programming in virtual reality. In: IEEE international conference on robotics and automation, Kobe, Japan

  • Bergamasco M, Degl’Innocenti P, Bucciarelli D (1994) A realistic approach for grasping and moving virtual objects. In: IEEE/RSJ/GI international conference on advanced robotic systems and the real world, IROS, pp 3489–3494

  • Borst CW, Indugula AP (2005) Realistic virtual grasping. In: IEEE conference on virtual reality, pp 2938–2943

  • Chen K, Henrioud JM (1994) Systematic generation of assembly precedence graphs. In: IEEE international conference on robotics and automation, pp 1476–1482

  • Cortes J, Jaillet L, Simeon T (2008) Disassembly path planning for complex articulated objects. IEEE Trans Rob 24(2):475–481

    Article  Google Scholar 

  • Dong T, Zhang L, Tong R, Dong J (2006) A hierarchical approach to disassembly sequence planning for mechanical product. Int J Adv Manuf Technol 30:507–520

    Article  Google Scholar 

  • Gadh R, Srinivasan H, Nuggehalli S, Figueroa R (1998) Virtual disassembly—a software tool for developing product dismantling and maintenance systems. In: IEEE annual reliability and maintainability symposium

  • Garbaya S, Zaldivar-Colado U (2007) The affect of contact force sensations on user performance in virtual assembly tasks. Virtual Real 11(4):287–299

    Article  Google Scholar 

  • Halperin D, Latombe JC, Wilson RH (1998) A general framework for assembly planning: the motion space approach. In: ACM annual symposium on computational geometry, Minneapolis, USA

  • Hirota K, Hirose M (2003) Dexterous object manipulation based on collision response. In: IEEE conference on virtual reality

  • Homem de Mello LS, Sanderson AC (1990) AND/OR graph representation of assembly plans. IEEE Trans Rob Autom 6(2):188–199

    Article  Google Scholar 

  • Howard BM, Vance JM (2007) Desktop haptic virtual assembly using physically based modeling. Virtual Real 11(4):207–215

    Article  Google Scholar 

  • Huagen W, Luo Y, Gao S, Peng Q (2004) Realistic virtual hand modeling with applications for virtual grasping. In: ACM SIGGRAPH international conference on virtual reality continuum and its applications in industry, pp 81–87

  • Ikeuchi K, Suehiro T (1994) Toward an assembly plan from observation, part I: task recognition with polyhedral objects. IEEE Trans Rob Autom 10(3):368–385

    Article  Google Scholar 

  • Jayaram S, Jayaram U, Wang Y, Tirumali H, Lyons K, Hart P (1999) Vade: a virtual assembly design environment. IEEE Comput Graph Appl 19(6):44–50

    Article  Google Scholar 

  • Lee S (1994) Subassembly identification and evaluation for assembly planning. IEEE Trans Syst Man Cybern 24(3):493–503

    Article  Google Scholar 

  • Lee S, Wang FC (1993) Physical reasoning of interconnection forces for efficient assembly planning. In: IEEE international conference on robotics and automation, Atlanta, USA

  • Lee S, Yi C (1993) Subassembly stability and reorientation. In: IEEE international conference on robotics and automation, pp 521–526

  • Lim T, Ritchie JM, Dewar RG, Corney JR, Wilkinson P, Calis M, Desmulliez M, Fang JJ (2007) Factors affecting user performance in haptic assembly. Virtual Real 11(4):241–252

    Article  Google Scholar 

  • Loomis A, Balkcom D (2006) Computation reuse for rigid-body dynamics. In: IEEE international Conference on Robotics and Automation, pp 4181–4186

  • Mattikalli RS, Khosla PK, Xu Y (1990) Subassembly identification and motion generation for assembly: a geometric approach. In: IEEE international conference on systems engineering, pp 399–403

  • Mattikalli R, Baraff D, Khosla P (1996) Finding all stable orientations of assemblies with friction. IEEE Trans Rob Autom 12(2):290–301

    Article  Google Scholar 

  • Mosemann H, Rohrdanz F, Wahl FM (1997) Stability analysis of assemblies considering friction. IEEE Trans Rob Autom 13(6):805–813

    Article  Google Scholar 

  • Ogata H, Takahashi T (1994) Robotic assembly operation teaching in a virtual environment. IEEE Trans Rob Autom 10(3):391–399

    Article  Google Scholar 

  • Ogawara K, Takamatsu J, Kimura H, Ikeuchi K (2003) Estimation of essential interactions from multiple demonstrations. In: Proceedings of the IEEE international conference on robotics and automation (ICRA)

  • Ong NS, Wong YC (1999) Automatic subassembly detection from a product model for disassembly sequence generation. Int J Adv Manuf Technol 15:425–431

    Article  Google Scholar 

  • Pardowitz M, Zöllner R, Dillmann R (2005) Learning sequential constraints of tasks from user demonstrations. In: IEEE-RAS international conference on humanoid robots, pp 424–429

  • Ramos C, Rocha J, Vale Z (1997) Analysis of the complexity of precedence graphs for assembly and task planning. In: IEEE international symposium on assembly and task planning, pp 19–24

  • Sappa AD, Garcia MA (2004) Hierarchical clustering of 3D objects and its application to minimum distance computation. In: IEEE international conference on robotics and automation, pp 5287–5292

  • Sundaram S, Remmler I, Amato NM (2001) Disassembly sequencing using a motion planning approach. In: IEEE international conference on robotics and automation, pp 1475–1480

  • Sung R, Ritchie JM, Lim T, Medelln H (2009) Assembly planning and motion study using virtual reality. In: ASME/AFM world conference on innovative virtual reality (WINVR), Chalon-sur-Saone, France

  • Torres F, Puente ST, Aracil R (2003) Disassembly planning based on precedence relations among assemblies. Intl J Adv Manuf Technol 21:317–327

    Article  Google Scholar 

  • Waarts JJ, Boneschanscher N, Bronsvoort WF (1992) A semi-automatic assembly sequence planner. In: IEEE international conference on robotics and automation, pp 2431–2438

  • Zaeh MF, Egermeier H, Petzold B, Schmid H (2004) Haptic interaction with a glove interface in a physics based virtual environment. In: International conference on artificial reality and telexistence

  • Zöllner R, Pardowitz M, Knoop S, Dillmann R (2005) Towards cognitive robots: building hierarchical task representations of manipulations from human demonstration. In: IEEE international conference on robotics and automation, pp 1535–1540

Download references

Acknowledgments

This research is partially supported by Laboratory AER-TECH of Regione Emilia-Romagna, Italy.

Author information

Authors and Affiliations

  1. Dipartimento di Ingegneria dell’Informazione, University of Parma, Viale G.P. Usberti 181/A, Parma, Italy

    Jacopo Aleotti & Stefano Caselli

Authors
  1. Jacopo Aleotti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefano Caselli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jacopo Aleotti.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Aleotti, J., Caselli, S. Physics-based virtual reality for task learning and intelligent disassembly planning. Virtual Reality 15, 41–54 (2011). https://doi.org/10.1007/s10055-009-0145-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-009-0145-y

Keywords

Search

Navigation