MOLIYAVIY YANGILIKLARNI KLASSIFIKATSIYALASHDA TRANSFORMER MODELLARNING QIYOSIY TAHLILI
Maqola haqida umumiy ma'lumotlar
Ushbu maqolada moliyaviy yangiliklarni avtomatik klassifikatsiyalash masalasida qoʻllaniladigan transfer oʻrganish (transfer learning) va transformer arxitekturasiga asoslangan modellar qiyosiy tahlil qilinadi. Domenga moslashtirilgan FinBERT oilasi (Araci, Yang va Liu variantlari), FLANG, hamda yirik generativ modellar — BloombergGPT, FinGPT va FinMA — arxitekturasi, oldindan oʻqitish strategiyasi, hisoblash xarajati va aniqlik koʻrsatkichlari boʻyicha solishtiriladi. Tahlil natijalari shuni koʻrsatadiki, klassifikatsiya kabi tor vazifalarda ixcham encoder modellar koʻpincha oʻnlab milliard parametrli generativ modellardan kam emas, balki ulardan ustun natija beradi. Maqolada, shuningdek, kam resursli va koʻp tilli sharoit, jumladan oʻzbek tilidagi moliyaviy matnlar uchun amaliy tavsiyalar keltirilgan.
1. Araci, D. (2019). FinBERT: Financial Sentiment Analysis with Pre-trained Language Models. arXiv:1908.10063. https://arxiv.org/abs/1908.10063
2. Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT. https://arxiv.org/abs/1810.04805
3. Liu, Z., Huang, D., Huang, K., Li, Z., & Zhao, J. (2020). FinBERT: A Pre-trained Financial Language Representation Model for Financial Text Mining. IJCAI-20, 4513–4519. https://doi.org/10.24963/ijcai.2020/622
4. Loughran, T., & McDonald, B. (2011). When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10-Ks. The Journal of Finance, 66(1), 35–65. https://doi.org/10.1111/j.1540-6261.2010.01625.x
5. Malo, P., Sinha, A., Korhonen, P., Wallenius, J., & Takala, P. (2014). Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Texts. JASIST, 65(4), 782–796. https://doi.org/10.1002/asi.23062
6. Shah, R., Chawla, K., Eidnani, D., Shah, A., Du, W., Chava, S., Raman, N., Smiley, C., Chen, J., & Yang, D. (2022). When FLUE Meets FLANG: Benchmarks and Large Pretrained Language Model for Financial Domain. EMNLP, 2322–2335. https://aclanthology.org/2022.emnlp-main.148/
7. Tang, Y., & Yang, Y. (2025). FinMTEB: Finance Massive Text Embedding Benchmark. arXiv:2502.10990. https://arxiv.org/abs/2502.10990
8. Vaswani, A., Shazeer, N., Parmar, N., et al. (2017). Attention Is All You Need. NeurIPS. https://arxiv.org/abs/1706.03762 9. Wu, S., Irsoy, O., Lu, S., et al. (2023). BloombergGPT: A Large Language Model for Finance. arXiv:2303.17564. https://arxiv.org/abs/2303.17564
10. Xie, Q., Han, W., Zhang, X., Lai, Y., Peng, M., Lopez-Lira, A., & Huang, J. (2023). PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Finance. NeurIPS Datasets and Benchmarks. https://arxiv.org/abs/2306.05443
11. Xie, Q., Han, W., Chen, Z., et al. (2024). FinBen: A Holistic Financial Benchmark for Large Language Models. NeurIPS Datasets and Benchmarks. https://arxiv.org/abs/2402.12659
Abdullayev, . S. (2026). MOLIYAVIY YANGILIKLARNI KLASSIFIKATSIYALASHDA TRANSFORMER MODELLARNING QIYOSIY TAHLILI. Academic Research in Educational Sciences, (), 21–28. https://doi.org/
Abdullayev, A. . “MOLIYAVIY YANGILIKLARNI KLASSIFIKATSIYALASHDA TRANSFORMER MODELLARNING QIYOSIY TAHLILI.” Academic Research in Educational Sciences, vol. , no. , 2026, pp. 21–28, https://doi.org/.
Abdullayev, S. 2026. MOLIYAVIY YANGILIKLARNI KLASSIFIKATSIYALASHDA TRANSFORMER MODELLARNING QIYOSIY TAHLILI. Academic Research in Educational Sciences. (), pp.21–28.
O'zbekcha
English
Русский