{"id":67096,"date":"2026-07-28T09:14:08","date_gmt":"2026-07-28T02:14:08","guid":{"rendered":"https:\/\/aws.cmctelecom.vn\/2026\/07\/28\/aws-ra-mat-takc-ky-thuat-nen-tri-thuc-ai-vuot-gioi-han-cua-rag\/"},"modified":"2026-07-28T09:53:18","modified_gmt":"2026-07-28T02:53:18","slug":"aws-ra-mat-takc-ky-thuat-nen-tri-thuc-ai-vuot-gioi-han-cua-rag","status":"publish","type":"post","link":"https:\/\/aws.cmctelecom.vn\/en\/2026\/07\/28\/aws-ra-mat-takc-ky-thuat-nen-tri-thuc-ai-vuot-gioi-han-cua-rag\/","title":{"rendered":"AWS ra m\u1eaft TAKC: K\u1ef9 thu\u1eadt n\u00e9n tri th\u1ee9c AI, v\u01b0\u1ee3t gi\u1edbi h\u1ea1n c\u1ee7a RAG"},"content":{"rendered":"

\u0110\u1ed1i v\u1edbi c\u00e1c t\u00e1c v\u1ee5 ph\u00e2n t\u00edch ph\u1ee9c t\u1ea1p tr\u00ean h\u00e0ng tr\u0103m t\u00e0i li\u1ec7u, k\u1ef9 thu\u1eadt Sinh t\u0103ng c\u01b0\u1eddng truy v\u1ea5n (RAG) \u0111ang d\u1ea7n b\u1ed9c l\u1ed9 gi\u1edbi h\u1ea1n. \u0110\u1ec3 gi\u1ea3i quy\u1ebft v\u1ea5n \u0111\u1ec1 n\u00e0y, AWS \u0111\u00e3 gi\u1edbi thi\u1ec7u Task-aware knowledge compression<\/em> (TAKC), m\u1ed9t ph\u01b0\u01a1ng ph\u00e1p n\u00e9n to\u00e0n b\u1ed9 c\u01a1 s\u1edf tri th\u1ee9c th\u00e0nh c\u00e1c bi\u1ec3u di\u1ec5n d\u00e0nh ri\u00eang cho t\u1eebng t\u00e1c v\u1ee5, gi\u00fap gi\u1ea3m \u0111\u00e1ng k\u1ec3 chi ph\u00ed token v\u00e0 t\u0103ng c\u01b0\u1eddng kh\u1ea3 n\u0103ng ph\u00e2n t\u00edch s\u00e2u.<\/p>\n

V\u01b0\u1ee3t qua gi\u1edbi h\u1ea1n c\u1ee7a RAG v\u1edbi n\u00e9n tri th\u1ee9c theo t\u00e1c v\u1ee5 (TAKC)<\/h2>\n

Khi c\u00e1c doanh nghi\u1ec7p s\u1eed d\u1ee5ng RAG cho c\u00e1c nhi\u1ec7m v\u1ee5 ph\u00e2n t\u00edch ph\u1ee9c t\u1ea1p nh\u01b0 th\u1ea9m \u0111\u1ecbnh t\u00e0i ch\u00ednh hay r\u00e0 so\u00e1t tu\u00e2n th\u1ee7 ph\u00e1p l\u00fd, h\u1ecd th\u01b0\u1eddng g\u1eb7p ph\u1ea3i m\u1ed9t r\u00e0o c\u1ea3n l\u1edbn. Vi\u1ec7c t\u00ecm ki\u1ebfm d\u1ef1a tr\u00ean s\u1ef1 t\u01b0\u01a1ng \u0111\u1ed3ng (similarity search) c\u1ee7a RAG c\u00f3 th\u1ec3 l\u1ea5y ra c\u00e1c \u0111o\u1ea1n th\u00f4ng tin li\u00ean quan nh\u01b0ng l\u1ea1i th\u01b0\u1eddng b\u1ecf l\u1ee1 c\u00e1c m\u1ed1i li\u00ean k\u1ebft quan tr\u1ecdng gi\u1eefa nhi\u1ec1u t\u00e0i li\u1ec7u kh\u00e1c nhau.<\/p>\n

V\u00ed d\u1ee5, m\u1ed9t c\u00f4ng ty c\u1ed5 ph\u1ea7n t\u01b0 nh\u00e2n \u0111ang th\u1ea9m \u0111\u1ecbnh m\u1ed9t th\u01b0\u01a1ng v\u1ee5 mua l\u1ea1i tr\u1ecb gi\u00e1 500 tri\u1ec7u USD. H\u1ecd ph\u1ea3i ph\u00e2n t\u00edch b\u00e1o c\u00e1o t\u00e0i ch\u00ednh c\u1ee7a 12 c\u00f4ng ty con trong 5 n\u0103m, c\u00f9ng v\u1edbi h\u01a1n 200 h\u1ee3p \u0111\u1ed3ng nh\u00e0 cung c\u1ea5p v\u00e0 50 v\u1ee5 ki\u1ec7n ph\u00e1p l\u00fd. Khi m\u1ed9t nh\u00e0 ph\u00e2n t\u00edch h\u1ecfi v\u1ec1 r\u1ee7i ro t\u00e0i ch\u00ednh h\u1ee3p nh\u1ea5t d\u1ef1a tr\u00ean c\u00e1c \u0111i\u1ec1u kho\u1ea3n nh\u00e0 cung c\u1ea5p v\u00e0 c\u00e1c v\u1ee5 ki\u1ec7n \u0111ang ch\u1edd x\u1eed l\u00fd, RAG kh\u00f4ng th\u1ec3 \u0111\u01b0a ra c\u00e2u tr\u1ea3 l\u1eddi t\u1ed5ng h\u1ee3p v\u00ec c\u00e1c th\u00f4ng tin li\u00ean quan n\u1eb1m r\u1ea3i r\u00e1c trong h\u00e0ng tr\u0103m t\u00e0i li\u1ec7u v\u00e0 kh\u00f4ng c\u00f3 s\u1ef1 t\u01b0\u01a1ng \u0111\u1ed3ng v\u1ec1 m\u1eb7t t\u1eeb v\u1ef1ng.<\/p>\n

TAKC gi\u1ea3i quy\u1ebft v\u1ea5n \u0111\u1ec1 n\u00e0y b\u1eb1ng c\u00e1ch s\u1eed d\u1ee5ng m\u1ed9t m\u00f4 h\u00ecnh ng\u00f4n ng\u1eef l\u1edbn (LLM) \u0111\u1ec3 t\u1ea1o ra c\u00e1c b\u1ea3n t\u00f3m t\u1eaft ng\u1eafn g\u1ecdn, t\u1eadp trung v\u00e0o t\u1eebng t\u00e1c v\u1ee5 c\u1ee5 th\u1ec3. Thay v\u00ec m\u1ed9t b\u1ea3n t\u00f3m t\u1eaft chung chung, TAKC t\u1ea1o ra c\u00e1c phi\u00ean b\u1ea3n n\u00e9n kh\u00e1c nhau cho c\u00e1c m\u1ee5c \u0111\u00edch kh\u00e1c nhau t\u1eeb c\u00f9ng m\u1ed9t t\u00e0i li\u1ec7u. V\u00ed d\u1ee5, m\u1ed9t b\u00e1o c\u00e1o th\u01b0\u1eddng ni\u00ean \u0111\u01b0\u1ee3c n\u00e9n cho m\u1ee5c \u0111\u00edch ph\u00e2n t\u00edch t\u00e0i ch\u00ednh s\u1ebd gi\u1eef l\u1ea1i c\u00e1c s\u1ed1 li\u1ec7u doanh thu, l\u1ee3i nhu\u1eadn, d\u00f2ng ti\u1ec1n; trong khi phi\u00ean b\u1ea3n n\u00e9n cho m\u1ee5c \u0111\u00edch r\u00e0 so\u00e1t tu\u00e2n th\u1ee7 s\u1ebd t\u1eadp trung v\u00e0o c\u00e1c tr\u00edch d\u1eabn quy \u0111\u1ecbnh v\u00e0 l\u1ecbch s\u1eed vi ph\u1ea1m.<\/p>\n

Qu\u00e1 tr\u00ecnh n\u00e9n n\u00e0y di\u1ec5n ra offline. Khi c\u00f3 truy v\u1ea5n, h\u1ec7 th\u1ed1ng s\u1ebd s\u1eed d\u1ee5ng phi\u00ean b\u1ea3n \u0111\u00e3 \u0111\u01b0\u1ee3c n\u00e9n s\u1eb5n thay v\u00ec t\u00e0i li\u1ec7u g\u1ed1c, gi\u00fap gi\u1ea3m s\u1ed1 l\u01b0\u1ee3ng token t\u1eeb 8 \u0111\u1ebfn 64 l\u1ea7n m\u00e0 v\u1eabn gi\u1eef l\u1ea1i th\u00f4ng tin quan tr\u1ecdng cho t\u00e1c v\u1ee5.<\/p>\n

N\u00e9n \u0111a t\u1ed1c \u0111\u1ed9 \u0111\u1ec3 t\u1ed1i \u01b0u chi ph\u00ed v\u00e0 hi\u1ec7u n\u0103ng<\/h2>\n

C\u00e1c truy v\u1ea5n kh\u00e1c nhau \u0111\u00f2i h\u1ecfi m\u1ee9c \u0111\u1ed9 chi ti\u1ebft kh\u00e1c nhau. M\u1ed9t c\u00e2u h\u1ecfi nh\u01b0 “Doanh thu qu\u00fd 3 l\u00e0 bao nhi\u00eau?” c\u1ea7n \u00edt ng\u1eef c\u1ea3nh h\u01a1n nhi\u1ec1u so v\u1edbi y\u00eau c\u1ea7u ph\u00e2n t\u00edch m\u1ed1i quan h\u1ec7 gi\u1eefa c\u00e1c \u0111i\u1ec1u kho\u1ea3n thanh to\u00e1n v\u00e0 d\u00f2ng ti\u1ec1n.<\/p>\n

TAKC gi\u1ea3i quy\u1ebft \u0111i\u1ec1u n\u00e0y b\u1eb1ng c\u00e1ch duy tr\u00ec b\u1ed1n c\u1ea5p \u0111\u1ed9 n\u00e9n cho m\u1ed7i lo\u1ea1i t\u00e1c v\u1ee5:<\/p>\n