employee
employee
employee
The article examines information security risks arising from the implementation of autonomous artificial intelligence agents in organizational activities. It is shown that the limited autonomy of an agent changes the nature of digital action through its ability to use available tools and interpret assigned goals with regard to the operational context. Particular attention is paid to prompt injection attacks, excessive privilege risks, incorrect task specification, and other threats associated with the deployment of autonomous agents within corporate information environments. The article proposes risk mitigation measures based on the separation of trusted and untrusted contextual information, the principle of least privilege, and the assignment of responsibility for agent-based operational scenarios. It is concluded that autonomous artificial intelligence agents can become a significant driver of productivity growth and a source of competitive advantage only under conditions of secure system design and continuous oversight of their actions.
autonomous agents, artificial intelligence, information security, agent-based systems, implementation risks, risk mitigation, privilege management, digital transformation
1. Voropaeva, N. V. Dekompoziciya raznotempovyh diskretnyh sistem upravleniya / N. V. Voropaeva, V. A. Sobolev // Mehatronika, avtomatizaciya, upravlenie. – 2004. – № 8. – S. 2-6. – EDN KMMQPJ.
2. Voropaeva, N. V. Dekompoziciya zadach upravleniya dlya raznotempovyh sistem s diskretnym vremenem / N. V. Voropaeva // XII vserossiyskoe soveschanie po problemam upravleniya VSPU-2014, Moskva, 16–19 iyulya 2014 goda / Institut problem upravleniya im. V.A. Trapeznikova RAN. – Moskva: Institut problem upravleniya im. V.A. Trapeznikova RAN, 2014. – S. 842-848. – EDN SSIATB.
3. Vliyanie standartizacii processov razrabotki PO na dostizhimost' konechnogo rezul'tata / K. V. Portnov, B. E. Zaberzhinskiy, G. V. Avanesyan [i dr.] // Aktual'nye problemy obschestva, ekonomiki i prava v kontekste global'nyh vyzovov : sbornik materialov XX Mezhdunarodnoy nauchno-prakticheskoy konferencii., Moskva, 17 maya 2023 goda. Tom Chast' 2. – Sankt-Peterburg: Pechatnyy ceh, 2023. – S. 19-23. – EDN MHRKKY.
4. A survey on large language model based autonomous agents / L. Wang, Ch. Ma, X. Feng [et al.] // Frontiers of Computer Science. – 2024. – Vol. 18, No. 6. – P. 186345. – DOIhttps://doi.org/10.1007/s11704-024-40231-1. – EDN XTFUTO.
5. Fedina, M. E. Ispol'zovanie avtonomnyh intellektual'nyh agentov dlya personalizacii obrazovatel'nyh traektoriy / M. E. Fedina, V. Yu. Zhivcov, E. O. Manyakova // Matematika i matematicheskoe modelirovanie : materialy III Vserossiyskoy nauchnoy konferencii, Samara, 20–21 noyabrya 2025 goda. – Samara: Samarama, 2026. – S. 170-174. – EDN ZRKZXK.
6. Shiverov, P. K. Doverie v kontekste analiza stoykosti protokolov autentifikacii / P. K. Shiverov, T. G. Novosad, M. N. Osipov // Polzunovskiy vestnik. – 2014. – № 2. – S. 248-250. – EDN SYNZJZ.
7. Analiz metodov emerdzhentnogo iskusstvennogo intellekta / K. V. Portnov, B. E. Zaberzhinskiy, R. R. Gabbasov, K. A. Agafonov // Aktual'nye problemy obschestva, ekonomiki i prava v kontekste global'nyh vyzovov : sbornik materialov XX Mezhdunarodnoy nauchno-prakticheskoy konferencii., Moskva, 17 maya 2023 goda. Tom Chast' 2. – Sankt-Peterburg: Pechatnyy ceh, 2023. – S. 30-36. – EDN GVVLER.
8. Bondarenko, V. V. Primenenie metodov matematicheskogo i funkcional'nogo analiza dlya issledovaniya smart-kontraktov / V. V. Bondarenko, V. Yu. Zhivcov, E. O. Manyakova // Matematika i matematicheskoe modelirovanie : materialy III Vserossiyskoy nauchnoy konferencii, Samara, 20–21 noyabrya 2025 goda. – Samara: Samarama, 2026. – S. 44-48. – EDN NYMOFM.
9. Artamonov, V. A. Obespechenie doveriya pri decentralizovannom vzaimodeystvii avtonomnyh agentov / V. A. Artamonov, V. Yu. Zhivcov // Kibernetika i informacionnaya bezopasnost' "KIB-2025" : Sbornik nauchnyh trudov Tret'ey Vserossiyskoy nauchno-tehnicheskoy konferencii. V 2-h tomah, Moskva, 03–04 dekabrya 2025 goda. – Moskva: Nacional'nyy issledovatel'skiy yadernyy universitet MIFI, 2025. – S. 114-115. – EDN GXSYSR.
10. Haritonov, E. V. Detektirovanie uyazvimostey na osnove grafovyh neyronnyh setey / E. V. Haritonov, V. Yu. Zhivcov // Kibernetika i informacionnaya bezopasnost' "KIB-2025" : Sbornik nauchnyh trudov Tret'ey Vserossiyskoy nauchno-tehnicheskoy konferencii. V 2-h tomah, Moskva, 03–04 dekabrya 2025 goda. – Moskva: Nacional'nyy issledovatel'skiy yadernyy universitet MIFI, 2025. – S. 72-73. – EDN IJSVEQ.
11. Awasthi, A. Beyond pre-training: the critical role of contextual data in real-world LLM applications / A. Awasthi // International Journal of Information Technology and Management Information Systems. – 2025. – Vol. 16, No. 2. – P. 1595-1608. – DOIhttps://doi.org/10.34218/ijitmis_16_02_100. – EDN EIVUWE.
12. Eliseev, E. E. Razrabotka adaptivnogo algoritma ocenki effektivnosti sistem obnaruzheniya vtorzheniy dlya predotvrascheniya web-ugroz / E. E. Eliseev, M. E. Burlakov, M. N. Osipov // Matematicheskoe i komp'yuternoe modelirovanie : Sbornik materialov IX Mezhdunarodnoy nauchnoy konferencii, posvyaschennoy 85-letiyu professora V.I. Potapova, Omsk, 19 noyabrya 2021 goda. – Omsk: Omskiy gosudarstvennyy universitet im. F.M. Dostoevskogo, 2021. – S. 285-287. – EDN IQCIIN.
13. Burlakov, M. E. Akusticheskie i vibroakusticheskie kanaly utechki informacii. Teoreticheskie osnovy i bazovyy praktikum / M. E. Burlakov, M. N. Osipov. – Samara : Samarskiy nacional'nyy issledovatel'skiy universitet im. akad. S.P. Koroleva, 2021. – 96 s. – ISBN 978-5-7883-1659-8. – EDN FJVXUU.
14. Avtomatizirovannyy kompleks opredeleniya form i chastotnyh harakteristik sobstvennyh kolebaniy / M. N. Osipov, N. A. Sharafutdinov, Yu. D. Scheglov [i dr.] // Izvestiya Samarskogo nauchnogo centra Rossiyskoy akademii nauk. – 2015. – T. 17, № 2-5. – S. 1072-1075. – EDN VOCBZL.
15. Novikov, S. Ya. Polnye sistemy v zadachah vosstanovleniya signala / S. Ya. Novikov, M. E. Fedina // Perspektivnye informacionnye tehnologii (PIT 2015) : trudy Mezhdunarodnoy nauchno-tehnicheskoy konferencii, Samara, 28–30 aprelya 2015 goda / SGAU. Tom 1. – Samara: Samarskiy nauchnyy centr RAN, 2015. – S. 280-284. – EDN TZIJDP.
16. Novikov, S. Ya. Polnye sistemy v zadachah vosstanovleniya signala / S. Ya. Novikov, M. E. Fedina // Izvestiya Samarskogo nauchnogo centra Rossiyskoy akademii nauk. – 2015. – T. 17, № 2-5. – S. 1069-1071. – EDN VOCBYR.
17. Voropaeva, N. V. Dekompoziciya raznotempovyh dinamicheskih sistem so slaboy dissipaciey / N. V. Voropaeva // Vestnik Samarskogo gosudarstvennogo universiteta. Estestvennonauchnaya seriya. – 2013. – № 9-2(110). – S. 5-10. – EDN RXWIDB.
18. Novikov, S. Y. Boundary spaces for inclusion map between rearrangement invariant spaces / S. Y. Novikov // Collectanea Mathematica. – 1993. – Vol. 44, No. 1-3. – P. 211-216. – EDN XJBRTG.
19. Novikov, S. Y. Singularities of embedding operators between symmetric function spaces on [0, 1] / S. Y. Novikov // Mathematical Notes. – 1997. – Vol. 62, No. 4. – P. 457-468. – DOIhttps://doi.org/10.1007/bf02358979. – EDN RQJYMB.
20. Novikov, S. Ya. Kotip i tip funkcional'nyh prostranstv Lorenca / S. Ya. Novikov // Matematicheskie zametki. – 1982. – T. 32, № 2. – S. 213-221. – EDN MYFHMD.
21. Stepanova, L. V. O geometrii oblasti polnost'yu povrezhdennogo materiala u vershiny treschiny antiploskogo sdviga v svyazannoy postanovke zadachi (svyazka "polzuchest' - povrezhdennost'") / L. V. Stepanova, M. E. Fedina // Vestnik Samarskogo gosudarstvennogo universiteta. Estestvennonauchnaya seriya. – 2001. – № 2(20). – S. 87-114. – EDN TISNND.
22. Ob odnoy modeli dinamicheskogo upravleniya potokom dannyh v radiokanale / V. P. Cvetov, G. I. Leonovich, S. Ya. Novikov [i dr.] // Perspektivnye informacionnye tehnologii (PIT 2015) : trudy Mezhdunarodnoy nauchno-tehnicheskoy konferencii, Samara, 28–30 aprelya 2015 goda / SGAU. Tom 1. – Samara: Samarskiy nauchnyy centr RAN, 2015. – S. 299-302. – EDN TZIJFN.
23. Karimov, B. F. Problemy adaptacii geneticheskih algoritmov k resheniyu zadach strukturno-parametricheskoy optimizacii / B. F. Karimov, K. V. Portnov // Sovremennye issledovaniya: teoriya, praktika, rezul'taty : Sbornik materialov Mezhdunarodnoy nauchno-prakticheskoy konferencii, Moskva, 29 dekabrya 2023 goda. – Moskva: Centr razvitiya obrazovaniya i nauki, OOO "Izdatel'stvo ALEF", 2023. – S. 443-448. – DOIhttps://doi.org/10.26118/1590.2023.63.10.010. – EDN PUGPKI.
