<?xml version="1.0" encoding="utf-8" standalone="yes" ?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Large Language Models | Teerapong Panboonyuen</title>
    <link>https://kaopanboonyuen.github.io/tag/large-language-models/</link>
      <atom:link href="https://kaopanboonyuen.github.io/tag/large-language-models/index.xml" rel="self" type="application/rss+xml" />
    <description>Large Language Models</description>
    <generator>Wowchemy (https://wowchemy.com)</generator><language>en-us</language><copyright>©2026 Kao Panboonyuen</copyright><lastBuildDate>Tue, 19 May 2026 09:00:00 +0000</lastBuildDate>
    <image>
      <url>https://kaopanboonyuen.github.io/media/icon_hueaa9297dc78a770d45cebdfb81bbca28_1203332_512x512_fill_lanczos_center_3.png</url>
      <title>Large Language Models</title>
      <link>https://kaopanboonyuen.github.io/tag/large-language-models/</link>
    </image>
    
    <item>
      <title>ASEAN Young Scientists Connect 2026 Pitching Trans-GMS LLM at Dusit Thani Bangkok</title>
      <link>https://kaopanboonyuen.github.io/talk/asean-young-scientists-connect-2026-pitching-trans-gms-llm-at-dusit-thani-bangkok/</link>
      <pubDate>Tue, 19 May 2026 09:00:00 +0000</pubDate>
      <guid>https://kaopanboonyuen.github.io/talk/asean-young-scientists-connect-2026-pitching-trans-gms-llm-at-dusit-thani-bangkok/</guid>
      <description>&lt;p&gt;&lt;img src=&#34;img_ASYC2026_IMG/Kao_AYSC_2026_007.jpg&#34; alt=&#34;ASEAN Young Scientists Connect 2026&#34;&gt;&lt;/p&gt;
&lt;h2 id=&#34;field-report-from-bangkok&#34;&gt;Field Report from Bangkok&lt;/h2&gt;
&lt;p&gt;At &lt;strong&gt;ASEAN Young Scientists Connect (AYSC) 2026&lt;/strong&gt;, hosted at &lt;strong&gt;Dusit Thani Bangkok&lt;/strong&gt;, researchers and innovators from across Southeast Asia gathered to discuss the future of artificial intelligence, healthcare technologies, and regional scientific collaboration. Among the featured presentations was &lt;strong&gt;Trans-GMS LLM&lt;/strong&gt;, a multilingual medical AI initiative designed for low-resource healthcare environments across the Greater Mekong Subregion.&lt;/p&gt;
&lt;p&gt;The event created a collaborative platform for young scientists, engineers, and researchers from ASEAN countries to exchange ideas on trustworthy AI, multilingual technologies, and inclusive innovation strategies capable of addressing regional healthcare challenges.&lt;/p&gt;
&lt;h2 id=&#34;pitching-trans-gms-llm-in-three-minutes&#34;&gt;Pitching Trans-GMS LLM in Three Minutes&lt;/h2&gt;
&lt;p&gt;One of the most challenging aspects of the session was translating a technically complex research project into a concise and compelling three-minute scientific pitch.&lt;/p&gt;
&lt;p&gt;The presentation introduced &lt;strong&gt;Trans-GMS LLM&lt;/strong&gt;, a multilingual large language model designed to support healthcare communication and medical intelligence across linguistically diverse Southeast Asian regions, including:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Thailand&lt;/li&gt;
&lt;li&gt;Laos&lt;/li&gt;
&lt;li&gt;Cambodia&lt;/li&gt;
&lt;li&gt;Myanmar&lt;/li&gt;
&lt;li&gt;Vietnam&lt;/li&gt;
&lt;li&gt;Malaysia&lt;/li&gt;
&lt;li&gt;Singapore&lt;/li&gt;
&lt;li&gt;Indonesia&lt;/li&gt;
&lt;li&gt;Philippines&lt;/li&gt;
&lt;li&gt;Brunei&lt;/li&gt;
&lt;li&gt;Timor-Leste&lt;/li&gt;
&lt;li&gt;China (Greater Mekong Subregion contex, Yunnan &amp;amp; Guangxi)&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Unlike globally dominant language models trained primarily on high-resource English datasets, Trans-GMS LLM focuses on underserved regional languages where healthcare communication remains difficult due to limited digital infrastructure and scarce annotated medical corpora.&lt;/p&gt;
&lt;h2 id=&#34;rethinking-medical-ai-for-southeast-asia&#34;&gt;Rethinking Medical AI for Southeast Asia&lt;/h2&gt;
&lt;p&gt;The project approaches multilingual healthcare AI as a regional accessibility challenge rather than a purely computational problem.&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;Building effective healthcare AI for Southeast Asia requires more than larger models. It requires culturally grounded language technologies capable of operating reliably across diverse linguistic and resource-constrained environments.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;The discussion emphasized several major research directions:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Developing multilingual medical reasoning capabilities for ASEAN languages&lt;/li&gt;
&lt;li&gt;Improving healthcare accessibility through localized AI systems&lt;/li&gt;
&lt;li&gt;Supporting trustworthy AI deployment in low-resource environments&lt;/li&gt;
&lt;li&gt;Enabling regional collaboration between ASEAN researchers and institutions&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;By positioning Southeast Asian languages as central design priorities rather than secondary adaptation targets, the project highlights the importance of inclusive AI development for emerging regions.&lt;/p&gt;
&lt;h2 id=&#34;a-regional-conversation-on-trustworthy-ai&#34;&gt;A Regional Conversation on Trustworthy AI&lt;/h2&gt;
&lt;p&gt;Beyond the technical presentation, the event reflected the growing momentum of scientific collaboration within ASEAN.&lt;/p&gt;
&lt;p&gt;Researchers exchanged perspectives on:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Cross-border AI research collaboration&lt;/li&gt;
&lt;li&gt;Responsible deployment of medical AI systems&lt;/li&gt;
&lt;li&gt;Data accessibility and multilingual representation&lt;/li&gt;
&lt;li&gt;Sustainable AI ecosystems for developing economies&lt;/li&gt;
&lt;li&gt;The future of regional language technologies&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;The atmosphere emphasized a shared vision of building AI systems grounded in local realities while remaining globally relevant.&lt;/p&gt;
&lt;h2 id=&#34;why-this-matters&#34;&gt;Why This Matters&lt;/h2&gt;
&lt;p&gt;Large language models are rapidly transforming healthcare and scientific research, yet many low-resource communities remain excluded due to language barriers and limited infrastructure.&lt;/p&gt;
&lt;p&gt;Projects such as &lt;strong&gt;Trans-GMS LLM&lt;/strong&gt; aim to reduce these gaps by exploring how multilingual foundation models can support:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;Healthcare communication&lt;/li&gt;
&lt;li&gt;Clinical knowledge access&lt;/li&gt;
&lt;li&gt;Medical education&lt;/li&gt;
&lt;li&gt;Decision-support systems&lt;/li&gt;
&lt;li&gt;Regional healthcare collaboration within ASEAN&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;The initiative demonstrates how trustworthy and culturally aware AI systems can contribute to more equitable access to healthcare technologies across Southeast Asia.&lt;/p&gt;
&lt;h2 id=&#34;looking-forward&#34;&gt;Looking Forward&lt;/h2&gt;
&lt;p&gt;ASEAN Young Scientists Connect 2026 demonstrated that the future of AI in Southeast Asia will depend not only on technological innovation, but also on regional collaboration, interdisciplinary thinking, and inclusive research ecosystems.&lt;/p&gt;
&lt;p&gt;Presenting Trans-GMS LLM at Dusit Thani Bangkok was more than a technical presentation — it was an opportunity to contribute to a broader regional conversation about the future of trustworthy, multilingual, and accessible AI for ASEAN communities.&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;img_ASYC2026_IMG/Kao_AYSC_2026_019.jpg&#34; alt=&#34;&#34;&gt;&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;img_ASYC2026_IMG/Kao_AYSC_2026_020.jpg&#34; alt=&#34;&#34;&gt;&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;img_ASYC2026_IMG/Kao_AYSC_2026_021.jpg&#34; alt=&#34;&#34;&gt;&lt;/p&gt;
&lt;p&gt;I would like to sincerely thank my new friends in Group 4 at ASEAN Young Scientists Connect 2026 for the inspiring discussions, collaborative spirit, and thoughtful exchange of ideas throughout the event. Working together on regional AI and healthcare challenges made the experience both intellectually enriching and genuinely memorable. I truly appreciate the openness, creativity, and energy everyone brought to the group, which made our short time together feel impactful and meaningful. I am grateful to have shared this journey with such talented and forward-thinking peers across the region.&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;img_ASYC2026_IMG/Kao_AYSC_2026_022.jpg&#34; alt=&#34;&#34;&gt;&lt;/p&gt;
&lt;p&gt;Overall, ASEAN Young Scientists Connect 2026 at Dusit Thani Bangkok was an inspiring and impactful experience that brought together diverse minds across Southeast Asia to exchange ideas on science, technology, and regional innovation. The event created a rare and valuable space for meaningful dialogue on how AI and emerging technologies can address real-world challenges, particularly in healthcare and low-resource settings. I am sincerely grateful to the organizers for their excellent coordination and for fostering such a vibrant and collaborative environment. It was an honor to be part of this gathering, and I leave with deep appreciation for the connections made, the insights shared, and the shared vision of advancing science for the benefit of the region.&lt;/p&gt;
</description>
    </item>
    
    <item>
      <title>GateKD: Confidence-Gated Closed-Loop Distillation for Robust Reasoning</title>
      <link>https://kaopanboonyuen.github.io/publication/gatekd-confidence-gated-closed-loop-distillation-for-robust-reasoning/</link>
      <pubDate>Wed, 13 May 2026 00:00:00 +0000</pubDate>
      <guid>https://kaopanboonyuen.github.io/publication/gatekd-confidence-gated-closed-loop-distillation-for-robust-reasoning/</guid>
      <description>&lt;!-- ![](featured.png) --&gt;
&lt;p&gt;GateKD (Confidence-Gated Closed-Loop Distillation) addresses a critical challenge in reasoning distillation: transferring reliable multi-step reasoning abilities from large language models into smaller student models without propagating hallucinated or noisy supervision. While conventional knowledge distillation methods treat the teacher model as a uniformly reliable oracle, real-world reasoning traces often contain uncertain intermediate steps, unstable rationales, and misleading attention patterns. GateKD reframes reasoning distillation as a confidence-aware closed-loop learning problem in which the teacher dynamically regulates how much information should be transferred during training.&lt;/p&gt;
&lt;blockquote&gt;
&lt;p&gt;The framework introduces three complementary confidence-gated mechanisms that collectively stabilize reasoning transfer. First, confidence-gated soft supervision selectively distills predictive signals only when the teacher exhibits high certainty. Second, gated hidden-state evolution aligns intermediate latent representations between teacher and student models while suppressing unreliable hidden dynamics. Third, reliability-filtered attention distillation transfers stable reasoning structures while filtering noisy or hallucinated attention maps that could otherwise corrupt student reasoning trajectories.&lt;/p&gt;
&lt;/blockquote&gt;
&lt;p&gt;Together, these components establish a closed feedback loop in which teacher confidence continuously modulates supervision strength across the distillation pipeline. Unlike traditional open-loop distillation approaches, GateKD enables the student model to learn reasoning behaviors from selectively trusted intermediate states rather than blindly imitating all teacher outputs. Extensive experiments across commonsense, logical, and symbolic reasoning benchmarks demonstrate consistent improvements over strong open-loop baselines using T5 and Flan-T5 architectures of varying sizes.&lt;/p&gt;
&lt;p&gt;Beyond empirical performance gains, GateKD highlights a broader paradigm shift toward confidence-aware reasoning supervision for trustworthy language models. The framework shows strong robustness under low-resource distillation settings, reduces hallucination transfer, and maintains stable reasoning fidelity even under noisy supervision conditions. These findings suggest that confidence-gated teacher-student interaction is a promising direction for building scalable, efficient, and reliable reasoning systems suitable for real-world deployment in resource-constrained environments.&lt;/p&gt;
&lt;p&gt;&lt;img src=&#34;featured.png&#34; alt=&#34;&#34;&gt;
&lt;img src=&#34;compact.png&#34; alt=&#34;&#34;&gt;&lt;/p&gt;
</description>
    </item>
    
  </channel>
</rss>
