# Guobin Tu > Guobin Tu is a master's student at Zhejiang University, working in the Interactive Data Group (IDG) at the State Key Lab of CAD&CG. His research interests include multimodal AI, human–computer interaction, and accessibility. Web page: https://www.tuguobin.site/ ## About Me I'm Guobin Tu, currently a master's student at [Zhejiang University](https://www.zju.edu.cn/english/) in the School of Software Technology, working in the [Interactive Data Group (IDG)](https://zjuidg.org/) at the [State Key Lab of CAD&CG](https://www.cad.zju.edu.cn/), advised by [Prof. Di Weng](https://dwe.ng/). I completed my undergraduate studies at the [University of Electronic Science and Technology of China (UESTC)](https://www.uestc.edu.cn/). My research interests include multimodal AI, human–computer interaction, and accessibility. ## News - 2026-11: I have released the code for [FEA-SLT](https://github.com/TuGuobin/FEA-SLT) on GitHub! - 2026-11: Our paper “[ChronoMantic: A Natural Language Interface for Interactive Time Series Pattern Query](https://www.tuguobin.site/#chronomantic)” has been published at ACM UIST 2026! - 2026-10: I presented my paper “[FEA-SLT: A Gloss-Free End-to-End Framework for Facial-Expression-Aware Sign Language Translation](https://www.tuguobin.site/#fea-slt)” at EMNLP 2026! - 2026-09: Our paper “[FEA-SLT](https://www.tuguobin.site/#fea-slt)” has been selected for an oral presentation at EMNLP 2026! I will present it in Budapest, Hungary. - 2025-09: I joined the [Interactive Data Group (IDG) at Zhejiang University](https://zjuidg.org/) to begin my research! - 2025-06: I graduated from the [University of Electronic Science and Technology of China (UESTC)](https://www.uestc.edu.cn/)! - 2025-04: I was named an Outstanding Graduate of Sichuan Province! ## Selected research ### FEA-SLT: A Gloss-Free End-to-End Framework for Facial-Expression-Aware Sign Language Translation Authors: Guobin Tu, Di Weng EMNLP 2026 · Accessibility, LLM Sign Language Translation (SLT) is a challenging cross-modal task requiring joint modeling of manual articulations and non-manual signals. Existing gloss-free SLT methods effectively capture gestural dynamics but often underutilize facial expressions, which play crucial grammatical and disambiguating roles. This limitation can cause semantic degradation when distinct concepts share similar manual configurations. To address this issue, we propose FEA-SLT (Facial-Expression-Aware Sign Language Translation), a gloss-free end-to-end framework that uses facial dynamics as semantic anchors for resolving manual ambiguity. FEA-SLT employs a domain-transferred facial encoder to extract expression-sensitive representations and integrates them with manual features through a linguistically constrained Facial-Expression-Aware Fusion (FEAF) module. FEAF captures reciprocal dependencies between manual and facial channels via bidirectional modulation, enhancing syntactic fidelity. Experiments on PHOENIX14T and CSL-Daily show that FEA-SLT achieves state-of-the-art BLEU performance among gloss-free methods, while targeted analyses confirm improved translation of facial-sensitive utterances. [Paper on the website](https://www.tuguobin.site/#fea-slt) · [PDF](https://www.tuguobin.site/pdf/fea-slt.pdf) · [Preprint](https://arxiv.org/abs/2601.03549) · [Code](https://github.com/TuGuobin/FEA-SLT) ### ChronoMantic: A Natural Language Interface for Interactive Time Series Pattern Query Authors: Yangtian Liu, Shuhan Liu, Guobin Tu, Yunfan Zhou, Xiwen Cai, Di Weng, Yingcai Wu UIST 2026 · LLM, HCI Finding time series patterns is an important problem in finance, healthcare, climatology, and manufacturing, where temporal data analysis informs critical decision-making processes. Existing approaches use examples, sketches, and natural language (NL) for time series pattern querying, but precisely formulating complex queries, inspecting query interpretations, and refining queries iteratively remain challenging. Nevertheless, NL is a promising modality for pattern specification, balancing expressiveness and preciseness while providing an intuitive means of articulating query intent. This paper introduces ChronoMantic, an NL-driven interactive interface for time series pattern querying. The tool provides glyph-based feedback on query interpretation and supports iterative querying through by-example refinement. We illustrate ChronoMantic’s workflow through two usage scenarios, assess its retrieval performance on a manually annotated benchmark, and evaluate its query effectiveness and usability via a two-stage user study. [Paper on the website](https://www.tuguobin.site/#chronomantic) · [PDF](https://www.tuguobin.site/pdf/chronomantic.pdf) · [Paper](https://doi.org/10.1145/3830398.3830491) ## Projects ### Jigsaw An online jigsaw puzzle with adjustable difficulty and custom image uploads. 2022-08-23 · Puzzle game · Vue 2 [Demo](https://jigsaw.tuguobin.site/) · [GitHub](https://github.com/tuguobin/jigsaw) ### Face Rating A social app prototype combining face analysis, profiles, and messaging with mock demo data. 2022-12-30 · Social prototype · Face API, Pusher [Demo](https://face.tuguobin.site/) · [GitHub](https://github.com/tuguobin/face-rating) ### Virtual Try-On An interface prototype for virtual try-on, exploring person and garment upload interactions. 2023-04-17 · Virtual try-on · Canvas, Web Video API [Demo](https://tryon.tuguobin.site/) · [GitHub](https://github.com/tuguobin/virtual-tryon) ### ZeQi Chat An online communication space with group conversations, direct messages, and file sharing. 2023-05-05 · Communication · Socket.IO [Demo](https://chat.tuguobin.site/) · [GitHub](https://github.com/tuguobin/zeqi-chat) ### Psychology A mental health information platform with assessments, topic explanations, and visual analysis. 2022-10-03 · Mental health · Apache ECharts, Koa [Demo](https://xinyi.tuguobin.site/) · [GitHub](https://github.com/tuguobin/xin-yi) ### TikTok Video A short-video web interface exploring playback, following, and social interactions. 2023-10-24 · Media interface · xgplayer, Swiper [Demo](https://douyin.tuguobin.site/) · [GitHub](https://github.com/CrazyYoung/7OxCloud) ### Fly View A website analysis tool that turns interaction data into scores and visual reports. 2023-05-24 · Visual analytics · Apache ECharts, OpenAI API, Puppeteer [Demo](https://flyview.tuguobin.site/) · [GitHub](https://github.com/tuguobin/flyview) ### Sound Flower A browser experiment that translates sound frequencies into evolving visual forms. 2024-09-24 · Audio visualization · Web Audio API, Canvas [Demo](https://sound.tuguobin.site/) · [GitHub](https://github.com/tuguobin/sound-flower) ### Mail Track An email tracking prototype for delivery and open activity; demo availability is limited. 2024-09-25 · Email tool · Next.js, PostgreSQL, Nodemailer [Demo](https://track.tuguobin.site/) · [GitHub](https://github.com/tuguobin/mail-track) ### Todo List A compact task manager that saves a personal to-do list in the browser. 2024-10-23 · Task management · localStorage [Demo](https://todo.tuguobin.site/) ### Gomoku A browser version of the classic five-in-a-row game with move undo. 2024-10-25 · Board game · React [Demo](https://gomoku.tuguobin.site/) · [GitHub](https://github.com/tuguobin/gomoku) ### React Flip Timer A flip clock exploring animated time displays, with count-up and countdown modes. 2025-03-15 · Interaction experiment · CSS3 [Demo](https://timer.tuguobin.site/) · [GitHub](https://github.com/tuguobin/react-flip-timer) ### My Website A personal website bringing together projects, experiments, and development work. 2025-04-05 · Portfolio · React, SCSS [Demo](https://www.tuguobin.site/) · [GitHub](https://github.com/tuguobin/tuguobin.github.io) ### Pose Modeler An interactive 3D figure for exploring skeletal movement and constructing human poses. 2025-05-21 · 3D interaction · Three.js [Demo](https://modeler.tuguobin.site/) · [GitHub](https://github.com/tuguobin/PoseModeler) ### Pose Estimation Real-time human pose estimation with a live 3D view of body movement. 2025-05-27 · Pose estimation · MediaPipe [Demo](https://pose.tuguobin.site/) · [GitHub](https://github.com/tuguobin/PoseEstimation) ### Easy DataFlow A visual workspace for designing, debugging, and exploring data processing workflows. 2025-10-11 · Data visualization · React Flow, Zustand, Monaco Editor [Demo](https://dataflow.tuguobin.site/) · [GitHub](https://github.com/tuguobin/easy-dataflow) ## Selected honors - Graduate Honors & Scholarships · Outstanding Graduate (UESTC & Sichuan) · Graduation & First-Class Scholarships - 2024 · Blue Bridge Cup · National First Prize · Web Development · University Group - 2024 · Blue Bridge Cup · Sichuan First Prize · Web Development · University Group - 2024 · Service Outsourcing Competition · National Third Prize - 2024 · Service Outsourcing Competition · Southwest Second Prize - 2024 · Collegiate Computing Competition · Sichuan First Prize - 2024 · IITC Certification · Intermediate · Industrial Internet Platform Engineer - 2024 · Sichuan Student Ability Certificate · Level A - 2023 · Blue Bridge Cup · Sichuan First Prize · Web Development · University Group - 2023 · Innovation & Entrepreneurship Program · Completed · Virtual Try-On Algorithm - 2023 · Qiniu 1024 Creative Festival · National Second Prize · Campus Hackathon - 2023 · Collegiate Computing Competition · Sichuan Third Prize · Xinyi · Information Visualization - 2023 · Collegiate Computing Competition · Sichuan Third Prize · Yunchang · AI Applications - 2023 · UESTC Science & Tech Exhibition · Outstanding Project · Yunchang - 2023 · E-Commerce Innovation Challenge · University Third Prize ## Contact - [Email](mailto:tuguobin@zju.edu.cn) - [GitHub](https://github.com/tuguobin)