unstructured: Server-Side Request Forgery in the URL-based partitioning
위협 신호 · CVSS · EPSS · KEV
이론적 심각도 점수
30일 내 악용 확률 예측
실측 악용 기록 없음
2주 이내 패치 — 우선 조치 대상
CVSS 벡터 · 메트릭
CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:C/C:H/I:L/A:N상세 설명
Summary
Server-Side Request Forgery in unstructured. The url= argument of partition(), partition_html(), and partition_md() is fetched via requests.get() with no host validation. The response body is returned as Element text, so this is a full-read SSRF — attackers reach loopback admin APIs, internal HTTP services, and cloud metadata endpoints, and read the response.
unstructured is the de facto URL ingestion layer for LangChain UnstructuredURLLoader, LlamaIndex UnstructuredReader, Chainlit, and many agent frameworks — secure defaults must live in the library, not in every downstream caller.
Details
Three sinks, all in unstructured == 0.22.26 (verified on main at 199f255):
unstructured/partition/auto.py:303—file_and_type_from_url(), reached viapartition(url=…).unstructured/partition/html/partition.py:160—partition_html(url=…). Post-fetchContent-Typecheck runs after the request hits the target.unstructured/partition/md.py:96—partition_md(url=…). No timeout (SSRF + slow-loris DoS).
None of is_private, is_loopback, ipaddress, gethostbyname, or allow_redirects appear in any of the three files. Three exploitation paths apply: direct private-IP target; redirect bypass (allow_redirects=True default); DNS rebinding (TOCTOU, closeable only by socket-pinning). Affected since 0.4.7 (Feb 2023) — ~219 releases, no validation ever introduced.
PoC
Local-only. pip install unstructured==0.22.26 flask requests.
internal_server.py:
1from flask import Flask, Response, jsonify 2app = Flask(__name__) 3 4@app.route("/imds") 5def imds(): return jsonify({"AccessKeyId": "ASIA-FAKE", "SecretAccessKey": "FAKE/SECRET"}) 6 7@app.route("/internal.html") 8def html(): return Response("<html><body><p>SK_LEAK_42</p></body></html>", mimetype="text/html") 9 10@app.route("/redir")11def redir(): return Response("", 302, headers={"Location": "http://127.0.0.1:9999/imds"})12 13if __name__ == "__main__": app.run(host="127.0.0.1", port=9999)exploit.py — uses the public top-level API:
1# Stub NLP helpers so the offline sandbox skips spaCy model download. 2# Does NOT affect the SSRF (which lives in the URL fetcher, before NLP). 3import unstructured.nlp.tokenize as _tk, unstructured.partition.text_type as _tt 4_tk.sent_tokenize = _tt.sent_tokenize = lambda t: [s for s in (t or "").split(". ") if s] 5_tk.word_tokenize = _tt.word_tokenize = lambda t: (t or "").split() 6_tk.pos_tag = _tt.pos_tag = lambda t: [(w, "NN") for w in (t or "").split()] 7 8from unstructured.partition.auto import partition 9L = "http://127.0.0.1:9999"10 11# A: partition(url=...) leaks internal HTML body12assert "SK_LEAK_42" in "\n".join(str(e) for e in partition(url=f"{L}/internal.html", languages=["eng"]))13# B: redirect bypass reaches simulated IMDS14assert "SecretAccessKey" in "\n".join(str(e) for e in partition(url=f"{L}/redir", languages=["eng"]))15print("PoC OK")In production the attacker substitutes 169.254.169.254, metadata.google.internal, or any internal address.
Impact
Attacker capabilities:
- Internal HTTP service read — loopback admin consoles, internal Elasticsearch/Redis/Consul/etcd HTTP fronts, Kubernetes API server, social/internal microservices. This is the most broadly exploitable capability and is unaffected by any cloud-side hardening.
- Cloud instance metadata access — reads metadata services that respond to unauthenticated GETs: GCP (
metadata.google.internal), Azure IMDS, Oracle Cloud, DigitalOcean, and EC2 instances still configured for IMDSv1 (which remains widely deployed in older accounts and in services that do not enforce IMDSv2-only). EC2 instances configured as IMDSv2-only are not exposed to direct credential theft via this SSRF, since IMDSv2 requires aPUTfor token acquisition; the SSRF still reaches the endpoint for reconnaissance and surface-mapping. - Side-effecting GET endpoints — magic-link consumers, job triggers, link-preview generators reachable on internal networks.
- Internal network reconnaissance — connection success/failure timing and error messages serve as a port and service scanner.
AI 심층 분석
공격 시나리오 · 재현 가능한 PoC 페이로드 · 즉시 적용 가능한 차단 패치를 한 번에 받아 보세요. 보안 운영팀이 그대로 점검·티켓팅에 쓸 수 있는 형태로 정리해 드립니다.
참고 자료 6
링크 내용 불러오는 중…