Peilin Feng

Peilin Feng

Beijing University of Aeronautics and Astronautics

My name is Peilin Feng (冯沛林), an undergraduate student at Beihang University(2021-2025), majoring in Automation Science and Electrical Engineering with a minor in Mathematical Sciences. Under the supervision of Professor Lei Huang, I am currently focusing on Deep neural network architecture design and Multimodal Understanding. In the future, I will contribute to project Tiny-Llava, where I aim to explore text and image modeling.

I also have a deep passion for mathematics. I serve as a teaching assistant for the Mathematical Analysis for Engineering course. My responsibilities include grading homework, answering students’ questions, and leading review lectures. Outside of my academic and research interests, I enjoy playing ping pong 🏓 and swimming 🤿. In my leisure time, I like to listen to some music 🎵 and watch my favorite cartoon Doraemon 📺 for relax.

My research interests span the intersection of NLP and Computer Vision, with a particular focus on Multimodal Understanding. This stems from my dedication to creating an AGI similar to Doraemon 🐱. Currently, I am actively working to bridge my knowledge gaps in this area, with the goal of becoming an expert in the field.

However, artificial intelligence is developing rapidly, so I always hope to be at the forefront of the field and use my intelligence to devote to our society. I believe that is an exciting exploring travel.

🔥 News

  • 2025.02:  🎉🎉 I successfully submitted two papers to ICML 2025, wishing good results.
  • 2025.01:  😊😊 I am excited to gain the opportunity to intern with the Multimodal Group at the Shanghai National AI Lab from Feb. 2025. I look forward to collaborating with like-minded mentors and peers on interesting and meaningful work.
  • 2024.12:  😭😭 My first paper to ICLR 2025 was unfortunately rejected. While it’s true that most people’s first submission is full of ups and downs, I still feel quite heartbroken. I hope my revised version will stand out at ICML. Fightning💪!
  • 2024.11:  🍀🍀 I’m currently chasing after a position to pursue my doctoral degree and would appreciate your valuable consideration. Thank you!
  • 2024.10:  🎉🎉 I successfully submitted my first paper to ICLR 2025, marking a woderful start to my research career. I hope I will be more excellent in the future.

📝 Publications

Under Review ICML 2025
sym

Universal Approximation Theorem of Networks Activated by Normalization

Yunhao Ni, Yuhe Liu, WenXin Sun, Yitong Tang, Peilin Feng, Yuxin Guo, Wenjun Wu✉, Lei Huang✉

💡 Contribution

  • Proposed Parallel Layer Normalization (PLN) to verify the universal approximation capability of normalization.
  • Compared the nonlinearity and optimization capability of PLN in time series prediction tasks.
  • Verified that PLN can serve as an activation function while compensating for the optimization capability of normalization.
Under Review ICML 2025
sym

An Empirical Study on Normalization in Mamba

Peilin Feng, Yuanshuai Wang, Yunhao Ni, Zekun Li, Lizhong Ding, Wenjun Wu✉, Lei Huang✉

💡 Contribution

  • Explored the effects of normalization type, position, and combination for Mamba architecture
  • Integrated extra normalization combinations before and after the SSM layer, significantly enhancing performance and training stability.
  • Provided intuitions on combination selection to improve the training dynamic
Under Review CVPR 2025
sym

Bench-CoE: a Framework for Collaboration of Experts from Benchmark

Yuanshuai Wang†, Xingjian Zhang†, Jinkun Zhao†, Siwei Wen, Peilin Feng, Shuhao Liao, Lei Huang✉, Wenjun Wu✉

💡 Contribution

  • We proposed a novel framework for Bench-CoE that relies solely on the Benchmark when training the router.
  • We comprehensively evaluated the performance and generalization ability of our Bench-CoE model across three stages: Naive, In-distribution, and Out-of-distribution.

🎖 Honors and Awards

  • 2024.12 Grand prize for Contests Scholarship in Beihang University
  • 2023.12 Outstanding student cadres
  • 2023.12 First Prize in the Chinese Mathematics Competition
  • 2023.12 First Prize in Beijing Mathematics Competition (top 0.5% in Beijing)
  • 2023.12 Second Prize for Contests Scholarship in Beihang University
  • 2023.12 Second Prize in China Undergraduate Mathematical Contest in Modeling
  • 2023.09 Outstanding Teaching Assistant in Mathematical Analysis(6/32)
  • 2023.06 Sencond Prize in Qixian Cup Robot Challenge Competition(4/32)
  • 2022.12 First Prize Scholarship in Beihang University (top5%)
  • 2022.06 Sencond Prize in Feng Ru Cup Science and Technology Innovation Competition

📖 Educations

  • 2022.09 - 2025.06 (Expected), Mathematical Science (Minor), Beihang University, Beijing, China.
  • 2021.09 - 2025.06 (Expected), Automation Science (Major), Beihang University, Beijing, China.

💬 Tutorial Materials in Teaching Assistant

🎤 Lectures:

  • 2022.11,  Tutorial, Mathematical Analysis: Indefinite Integral. | [video]
  • 2022.10,  Tutorial, Mathematical Analysis: Equivalent Transform. | [video]
  • 2022.09,  Tutorial, Mathematical Analysis: Limit in Recursion sequence. | [video]
  • 2021.12,  Tutorial, Mathematical Analysis: Integration by parts. | [video]
  • 2021.11,  Tutorial, Mathematical Analysis: Rolle’s theorem. | [video]

📄 Test:

  • 2022.10,  Mock Mid-term Exam, Mathematical Analysis(I) | [Test] & | [Answer]
  • 2023.04,  Mock Mid-term Exam, Mathematical Analysis(II) | [Test] & | [Answer]

💻 Internships

SHLAB
CAST