Precision Psychiatry Wiki

Supporting collaborations

5 min read

Supporting collaborations

Historical or one-off collaborations that support NIPG’s credibility. Per Editorial safeguards, none of these receives a dedicated wiki page; they live here and inside the capability portfolio and bibliography.

Sorbonne

Dr. Bruno Melício — PhD from ELTE’s NIPG, now a postdoc at Sorbonne applying AI, including generative AI, to detection and diagnosis of neurodevelopmental disorders. Confirms an active ELTE → international-postdoc pipeline, and he is a co-collaborator on the ADOS-2 multimodal work.

Delft University of Technology / MeMo

Introducing MeMo: A Multimodal Dataset for Memory Modelling in Multiparty Conversations — Maria Tsfasman, Bernd Dudzik, Kristian Fenech, András Lőrincz, Catholijn M. Jonker, Catharine Oertel (arXiv).

  • The corpus. 31 hours of small-group discussion, repeated three times over two weeks, with participant memory reports and multimodal behavioural and perceptual measures.
  • What it establishes. A previous scientific connection with Jonker and Oertel, and experience analysing data collected in Delft.
  • What it supports. Future work on conversational memory, group dynamics, repeated interaction, avatars, and systems that assist conversation or learning.

Safeguard. Not a clinical dataset.

DFKI (Daniel Sonntag & NIPG)

Four documented joint outputs across video annotation, assistive communication, mental-health-oriented virtual environments, and human–robot perception.

WorkYearWhat it demonstrates
LabelMovie: a Semi-supervised Machine Annotation Tool with Quality Assurance and Crowd-sourcing Options for Videos (Palotai et al., CBMI) — authors include Sonntag and Lőrincz (DFKI record)2014Expert video annotation, combining and filtering annotations, bootstrapping machine annotation from manually labelled examples. Highest relevance to the data ecosystem: human-in-the-loop annotation and quality assurance
Maintain and Improve Mental Health by Smart Virtual Reality Serious Games — 5th International Symposium on Pervasive Computing Paradigms for Mental Health (bibliography)2015Early shared work on VR and serious games for mental health; context for today’s avatar and game-based research
Cross-Viewpoint Semantic Mapping: Integrating Human and Robot Perspectives for Improved 3D Semantic Reconstruction (Kopácsi et al., Sensors 23(11) 5126) plus a 2022 ECCV workshop contribution and code, under the HumanE AI project 3D Semantic Label Transfer and Matching in Human-Robot Collaboration (project, DOI)2022–2023Transferring semantic information between human and robot viewpoints
Recommending Missing Symbols of Augmentative and Alternative Communication by Means of Explicit Semantic Analysis (Vörös et al., AAAI Fall Symposium), coauthored by Sonntag and Lőrincz (paper)2014Context-related symbol recommendation for AAC; an example of language-supported accessible interaction

Transfer value. This experience is relevant to annotation protocols, reviewer agreement, manual checking of automated outputs, and potential reanalysis of historical educational recordings. → Data governance and annotation

Safeguard. Historical joint work only. It does not establish DFKI’s commitment to the Precision Psychiatry programme. The 2014-era tools are not claimed to be maintained or clinically deployable today; a present-day implementation would require its own capability, licensing, security, and governance review.

Extended bibliography. Other joint work is less central to the psychiatry narrative: Fine-tuning deep CNN models on specific MS COCO categories (2017, arXiv), and Overview of the CPS for Smart Factories Project, connecting Sonntag, Sonja Zillner, Patrick van der Smagt and Lőrincz — use selectively for industrial collaboration history, and verify publication metadata before exporting a formal citation.

Richter / Colleyeder (2013, historical)

A confidential 2013 project plan prepared by Colleyeder Ltd. (a small company associated with ELTE) for Gedeon Richter, titled Computerized game like diagnostic tool to aid predominantly negative schizophrenia diagnostics. PNS in the document refers to predominantly negative-symptom schizophrenia.

  • The concept. An avatar-guided game environment combined with facial gesture estimation, imitation, pantomime, head-movement tasks and other activities, plus automated observation, adaptive testing, feasibility checkpoints, and a potential pathway toward a clinical device.
  • What happened. Per András Lőrincz’s account as project owner, the exploratory project successfully completed a preliminary game-development stage, for which Richter paid. Development then stopped following changes in Richter’s priorities.
  • Why it matters now. Advances in avatar technology, studies reporting benefits of patient–avatar interactions, and ongoing avatar studies at a Semmelweis clinic have renewed the relevance of this early work.

Safeguard. Cite as historical precedent, not an active project.

Separately, Gedeon Richter Plc awarded the Richter Merit Medal to Prof. Dr. János Kálmán for his development of the Speech-GAP Test® — a second, independent Richter connection. → Speech Gap

Educational-games archive (2013 NIPS workshop)

Towards entertaining and efficient educational games — András Lőrincz, Gyöngyvér Molnár, László A. Jeni, Zoltán Tősér, Attila Rausch, Jeffrey F. Cohn, Benő Csapó. Combined inductive-reasoning minigames, a game environment, face tracking, and avatar feedback. The abstract describes 180 primary-school participants; the illustrative video analyses used recordings from 57 children. Appeared at the NIPS Workshop on Data Driven Education, 2013, and should be described as a workshop contribution (programme).

Reuse potential. The archived recordings may support substantially richer analysis with current methods. A first feasibility study should inventory the material and test 5–10 accessible recordings from different participants or conditions. New extraction could cover observable head and facial movement, task orientation, task events, responses, errors, feedback, and performance. Speech can be added only if usable audio is present and authorised. → Adaptive assessment and serious games

Safeguard. No raw video of children in the public wiki — aggregate findings and dataset descriptions only.

NIPG · Bruno Melício · Capability portfolio · Bibliography · Datasets · Data governance and annotation

Graph View

Backlinks