FANG-LUE ZHANG | Victoria University of Wellington

 

Contact:

Phone: +64 4886 5340 (Work)

Email: fanglue.zhang (at) vuw.ac.nz

Address: Cotton Building 331, Victoria University of Wellington, Kelburn

Wellington 6012, New Zealand

 

 

Dr. Fang-Lue Zhang (张方略)

Senior Lecturer (Associate Professor) in Computer Graphics

Victoria University of Wellington, New Zealand

I am now a senior lecturer (associate professor) of computer graphics at Victoria University of Wellington (VUW). I have been working with the Victoria Graphics Group since 2017. From 2015 to 2017, I was a Post-doc in Tsinghua University (Beijing, China), working with Prof. Shi-Min Hu and the Graphics and Geometric Computing Group. I obtained my doctoral degree in 2015, supervised by Prof. Shi-Min Hu

     

My current research interests include deep learning-based image and video manipulation approaches and panoramic 360-degree image processing for Robotics and Virtual Reality applications. I have been actively contributing to computer graphics and image processing community. I received the Victoria Early-Career Research Excellence Award in 2019 and Marsden Fast-Start Grant in 2020. I served as program chair of Pacific Graphics 2020 and 2021. I am on the editorial board of Computer & Graphics. I am a committee member and the Industry Relationship Coordinator of IEEE Central New Zealand Sector.

     

-PhD scholarships are available now. If you are Interested, please contact Fang-Lue Zhang directly via Email

-**CVM 2024** will be hosted by our group at Wellington in April 2024

 

Grants & AwarDS  2021-2026, Marsden Fast-Start Grant, "Dynamic Panoramic Scene Reconstruction for Mixed Reality ", New Zealand Royal Society, NZD 300,000, PI.   2023-2026, Catalyst: Leaders -- Julius Von Haast Fellowship, "Holistic Volumetric Representation for Reconstructing Immersive Videos", New Zealand Royal Society, NZD 150,000, PI.   2022-2023, National Challenge 10, Ending With Impact project for "Adaptive Learning Robot to Complement the Human Workforce",  SfTI, NZD 89,497, VUW PI. 2022-2023, Industrial Project with The Cargo Cult ltd., Video Feature Exploration", The Cargo Cult,  NZD 2,657, PI 2022-2023, Commercialization seeding project, "Automatic High-resolution Line Art Colourization",  Tranche I, KiwiNet and UniVenture, NZD 20,000, PI. 2020-2021, Victoria Early Career Research Award, Victoria University of Wellington, NZD 5,000, PI. 2020, Best Reviewer Award, Computational Visual Media (Q1 journal). 2018-2023, International Exchange Project, "Structual Analysis of Stereoscopic 360-Degree Video for Mixed Reality",  Royal Society of UK, NZD 24,142, Oversea-PI 2019-2022, National Challenge 10, Robotic Spearhead project, "Adaptive Learning Robot to Complement the Human Workforce", Tranche II, SfTI, NZD 3,000,000, VUW PI (from 2021) and Key researcher. 2017-2019, National Challenge 10, Robotic Spearhead project, "Adaptive Learning Robot to Complement the Human Workforce", Tranche I, SfTI, NZD 2,000,000, Key researcher. 2017-2018, Research Establishment Grant, "Aesthetic oriented video editing and enhancement", VUW, NZD9,300, PI. 

Publications Selected Publications (Please refer to my Google Scholar page   for the full publication list)  

Software Screenshot

BiRD: Using Bidirectional Rotation Gain Differences to Redirect Users during Back-and-forth Head Turns in Walking

Sen-Zhe Xu, Fiona Xiao Yu Chen, Ran Gong, Fang-Lue Zhang, Song-Hai Zhang

IEEE VR 2024 (Journal Track), Honorable Mention for Best Paper

[PDF] [BIB] 

Software Screenshot

PPEA-Depth: Progressive Parameter-Efficient Adaptation for Self-Supervised Monocular Depth Estimation

Yue-Jiang Dong, Yuan-Chen Guo, Ying-Tian Liu, Fang-Lue Zhang, Song-Hai Zhang

AAAI 2024 Accepted

[PDF] [CODE] [BIB] 

Software Screenshot

Intrinsic Omnidirectional Image Decomposition with Illumination Pre-Extraction

Rong-Kai Xu, Lei Zhang, and Fang-Lue Zhang

IEEE TVCG, Accepted, 2024

[PDF] [BIB] 

Software Screenshot

MuNeRF: Robust Makeup Transfer in Neural Radiance Fields

Yu-Jie Yuan, Xinyang Han, Yue He, Fang-Lue Zhang, and Lin Gao

IEEE TVCG, Accepted, 2024

[PDF] [BIB] 

Software Screenshot

MAL: Motion-Aware Loss with Temporal and Distillation Hints for Self-Supervised Depth Estimation

Yue-Jiang Dong, Fang-Lue Zhang, Song-Hai Zhang

2024 IEEE International Conference on Robotics and Automation (ICRA), Accepted

[PDF] [BIB] 

Software Screenshot

Motif-GCNs with Local and Non-Local Temporal Blocks for Skeleton-Based Action Recognition

Yu-Hui Wen, Lin Gao, Hongbo Fu, Fang-Lue Zhang, Shihong Xia, Yong-Jin Liu

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), vol. 45, pp. 2009-2023, vol. 45, 2023 

[PDF] [CODE] [BIB] 

Software Screenshot

360° Stereo Image Composition with Depth Adaption

Kun Huang, Fang-Lue Zhang, Junhong Zhao, Yiheng Li, Neil A. Dodgson

IEEE Transactions on Visualization and Computer Graphics (TVCG), Accepted, 2023

[PDF][BIB] 

Software Screenshot

Rule-of-Thirds or Centered? A study in preference in photo composition

Weng Khuan Hoh, Fang-Lue Zhang,  Neil A. Dodgson

ACM SIGGRPAH Asia Poster, 2023

[PDF][BIB] 

Software Screenshot

A Survey on 360° Images and Videos in Mixed Reality: Algorithms and Applications

Fang-Lue Zhang, Junhong Zhao, Yun Zhang, Stefanie Zollmann

Journal of Computer Science and Technology 38(3): 473−491 May 2023.  

[PDF][BIB] 

Software Screenshot

Salient-Centeredness and Saliency Size in Computational Aesthetics

Weng Khuan Hoh, Fang-Lue Zhang, Neil Dodgson

ACM Transactions on Applied Perception (TAP) , Accepted, 2023 

 

Software Screenshot

Redirected Walking Based on Historical User Walking Data

Cheng-Wei Fan, Sen-Zhe Xu, Peng Yu, Fang-Lue Zhang, and Song-Hai Zhang

IEEE VR , Accepted, 2023 

[PDF]    [BIB]

Software Screenshot

Multi-User Redirected Walking in Separate Physical Spaces for Online VR Scenarios

Sen-Zhe Xu, Jia-Hong Liu, Miao Wang, Fang-Lue Zhang, and Song-Hai Zhang

IEEE Transactions on Visualization and Computer Graphics (TVCG), Accepted, 2023 

[PDF]  [BIB] 

Software Screenshot

Deep 360° Optical Flow Estimation Based on Multi-Projection Fusion

Yiheng Li, Connelly Barnes, Kun Huang, Fang-Lue Zhang

European Conference on Computer Vision (ECCV), 2022

[PDF] [CODE] [360 optical flow dataset] [BIB] 

Software Screenshot

Laplacian Mesh Transformer: Dual Attention and Topology Aware Network for 3D Mesh Classification and Segmentation

Xiao-Juan Li, Jie Yang, Fang-Lue Zhang

European Conference on Computer Vision (ECCV), 2022

[PDF][BIB] 

Software Screenshot

Casual 6-DoF: free-viewpoint panorama using a handheld 360° camera

Rongsen Chen, Fang-Lue Zhang, Simon Finnie, Andrew Chalmers, Taehyun Rhee

IEEE Transactions on Visualization and Computer Graphics (TVCG), Online Published, 2022

[PDF] [BIB] 

Software Screenshot

IMU-Assisted Online Video Background Identification

Jianxiang Rong, Lei Zhang, Hua Huang, Fang-Lue Zhang

IEEE Transactions on Image Processing (TIP), 31, pp. 4336-4351, 2022

[PDF] [BIB] 

Software Screenshot

Reference-based deep line art video colorization

Min Shi, Jia-Qi Zhang, Shu-Yu Chen, Lin Gao, Yukun Lai, Fang-Lue Zhang

IEEE Transactions on Visualization and Computer Graphics (TVCG), Online Published, 2022

[PDF][BIB] 

Software Screenshot

Rendering-Aware HDR Environment Map Prediction From A Single Image

Jun-Peng Xu, Chen-Yu Zuo, Fang-Lue Zhang, Miao Wang

Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 36(3), pp. 2857-2865, 2022

[PDF][BIB] 

Software Screenshot

Bullet Comments for 360° Video

Yi-Jun Li, Jinchuan Shi, Fang-Lue Zhang, Miao Wang

2022 IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), pp. 1-10, 2022

[PDF][BIB] 

Software Screenshot

Optimal Pose Guided Redirected Walking with Pose Score Precomputation

Sen-Zhe Xu, Tian Lv, Guangrong He, Chia-Hao Chen, Fang-Lue Zhang, Song-Hai Zhang

2022 IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), pp. 655-663, 2022

[PDF][BIB] 

Software Screenshot

Active colorization for cartoon line drawings

Shu-Yu Chen, Jia-Qi Zhang, Lin Gao, Yue He, Shihong Xia, Min Shi, Fang-Lue Zhang

IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), 22(7), pp. 1198-1208, 2022

[PDF][BIB] 

Software Screenshot

Content-Preserving Image Stitching With Piecewise Rectangular Boundary Constraints

Yun Zhang, Yu-Kun Lai, Fang-Lue Zhang

IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG), 27(7), pp.3198-3212, 2021

[PDF][BIB] 

Software Screenshot

Deep portrait image completion and extrapolation

Xian Wu, Rui-Long Li, Fang-Lue Zhang, Jian-Cheng Liu, Jue Wang, Ariel Shamir, Shi-Min Hu

IEEE Transactions on Image Processing (IEEE TIP), pp. 2344-2355, 2020

[PDF][BIB] 

Software Screenshot

Coherent video generation for multiple hand-held cameras with dynamic foreground

Fang-Lue Zhang, Connelly Barnes, Hao-Tian Zhang, Junhong Zhao, Gabriel Salas

Computational Visual Media, 6(3), 291-306, 2020 (Spotlight Paper)

[PDF][BIB] 

Software Screenshot

A survey on deep geometry learning: From a representation perspective

Yun-Peng Xiao, Yu-Kun Lai, Fang-Lue Zhang, Chunpeng Li, Lin Gao

Computational Visual Media, 6(2), 113-133, 2020 (Best Paper Award 2020 )

[PDF][BIB] 

Software Screenshot

Graph CNNs with Motif and Variable Temporal Block for Skeleton-based Action Recognition

Yu-Hui Wen, Lin Gao, Hongbo Fu, Fang-Lue Zhang, Shihong Xia

Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 33(01), 8989-8996, 2019

[PDF] [CODE][BIB] 

Software Screenshot

Detecting and removing visual distractors for video aesthetic enhancement

Fang-Lue Zhang, Xian Wu, Rui-Long Li, Jue Wang, Zhao-Heng Zheng, Shi-Min Hu

IEEE Transactions on Multimedia (IEEE TMM), vol. 20, no. 8, pp. 1987-1999, 2018

[PDF] [[Database (Extraction Code: nimd)][BIB] 

Software Screenshot

Robust Background Identification for Dynamic Video Editing

Fang-Lue Zhang, Xian Wu, Jue Wang, Hao-Tian Zhang, Shi-Min Hu

ACM Transactions on Graphics (ACM SIGGRAPH Asia 2016),  35, 6, 1--12, 2016

[Project page][PDF][BIB] 

Software Screenshot

A Survey of the State-of-the-art in Patch-based Synthesis

Connelly Barnes and Fang-Lue Zhang

Journal of Computational Visual Media, 2017

[PDF][BIB] 

Software Screenshot

PlenoPatch: Patch-based Plenoptic Image Manipulation

Fang-Lue Zhang, Jue Wang, Eli Shechtman, Zi-Ye Zhou, Jia-Xin Shi, Shi-Min Hu

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2017

[PDF][BIB] 

Software Screenshot

Simultaneous Camera Path Optimization and Distraction Removal for Improving Amateur Video

Fang-Lue Zhang, Jue Wang, Han Zhao, Ralph R. Martin, Shi-Min Hu

IEEE Transactions on Image Processing (TIP),Vol.24, No.12, 5982 - 5994. 2015

[PDF][BIB] 

Software Screenshot

PatchTable: Efficient Patch Queries for Large Datasets and Applications

Connelly Barnes , Fang-Lue Zhang , Liming Lou, Xian Wu, Shi-Min Hu

ACM Transactions on Graphics (SIGGRAPH 2015) 34, no. 4: 1-10. 2015

[Project Page][Large PDF][Compressed PDF][BibTex]

Software Screenshot

PatchNet: A Patch-based Image Representation for Interactive Library-driven Image Editing

Shi-Min Hu*, Fang-Lue Zhang, Miao Wang, Ralph R. Martin and Jue Wang

ACM Transactions on Graphics (SIGGRAPH Asia 2013), 32(6), pp.1-12. 2013

[Project Page][PDF][BIB] 

Software Screenshot

Aesthetic Image Enhancement by Dependence-Aware Object Recomposition

Fang-Lue Zhang, Miao Wang, Shi-Min Hu*

IEEE Transactions on Multimedia (TMM), 15(7). 2013

[PDF][BIB] 

Software Screenshot

ImageAdmixture: Putting Together Dissimilar Objects from Groups

Fang-Lue Zhang, Ming-Ming Cheng, Jiaya Jia, Shi-Min Hu* 

IEEE Transactions on Visualization and Computer Graphics (TVCG), 2012, 18(11), 1849-1857.

[PDF][BIB] 

Software Screenshot

RepFinder: Finding Approximately Repeated Scene Elements for Image Editing.

Ming-Ming Cheng, Fang-Lue Zhang, Niloy J. Mitra, Xiaolei Huang, Shi-Min Hu*.

ACM Transactions on Graphics (Proceedings of SIGGRAPH 2010), 30(4): article 98.

[Project Page]

Other publications: --Sphere Face Model: A 3D morphable model with hypersphere manifold latent space using joint 2D/3D training, D Jiang, Y Jin, FL Zhang, Z Zhu, Y Zhang, R Tong, M Tang, Computational Visual Media 9 (2), 279-296, 2023 [PDF] --Focusing on your subject: Deep subject-aware image composition recommendation networks, GY Yang, WY Zhou, Y Cai, SH Zhang, FL Zhang, Computational Visual Media 9 (1), 87-107, 2023 [PDF] --3D corrective nose reconstruction from a single image, Y Tang, Y Zhang, X Han, FL Zhang, YK Lai, R Tong, Computational Visual Media 8 (2), 225-237, 2022 [PDF] --Reconstructing Recognizable 3D Face Shapes based on 3D Morphable Models, D Jiang, Y Jin, R Deng, R Tong, F Zhang, Y Yai, M Tang, Computer Graphics Forum, 2022 [PDF] --Fast Edit Propagation for 360 Degree Panoramas Using Function Interpolation, Y Zhang, FL Zhang, Z Zhu, L Wang, Y Jin, IEEE Access 10, 43882-43894, 2022 [PDF] --Efficient propagation of sparse edits on 360° panoramas, Y Zhang, FL Zhang, YK Lai, Z Zhu, Computers & Graphics 96, 61-70, 2021 [PDF] --VR content creation and exploration with deep learning: A survey, M Wang, XQ Lyu, YJ Li, FL Zhang, Computational Visual Media 6 (1), 3-28, 2020 [PDF]


Professional Services 2022-now,    Associate Editor of Computer & Graphics 2022-now,    Committee Member and Industrial Relationship Coordinator of IEEE Central New Zealand Sector 2021-2022,  Guest Editor of the Special Issue of PG GEMs of Computer & Graphics 2021-now,   Consultancy Board member for Lingxi Tech Ltd 2021,   Program Chair of Pacific Graphics 2021 at Wellington, working with Elmar Eisemann and Karan Singh 2020,   Program Chair of Pacific Graphics 2020 (Virtual Only) at Wellington, working with Elmar Eisemann and Alec Jacobson 2018-2022,   Committee Member of International Conference on Computational Visual Media 2018-2022 2018-2022,   Committee Member of IVCNZ 2019,   Program Committee of Pacific Graphics 2019 2019,   Program Committee of CAD/Graphics 2019 2017,   Co-chair of PSIVT Workshop on Vision Meets Graphics

 

 

Teaching  Courses Taught in 2023:      CGRA352Image-Based Graphic,  Trimester 1      COMP261,   Algorithms and Data Structures, Trimester 1 CGRA151, Introduction to Computer Graphics and Games, Trimester 2        AIML431Current Topics in Artificial Intelligence, Trimester  2