Distributed Google Maps Review Repository dan Mining Service.
Internet
│
▼
Load Balancer SSL
│
▼
scrapgmap.niteni.web.id
│
▼
Apache Reverse Proxy
│
▼
NodeJS ScrapGMap
│
├── Mining Google Maps
├── Upload Collector
├── JSON Repository
└── API Service
ScrapGMap mendukung dua mode:
Laptop
│
▼
Mining Review
│
▼
Upload JSON
│
▼
VPS
│
▼
Mining Review
│
▼
Upload JSON
│
▼
Repository Utama
scrapgmap.niteni.web.id
data/
└── PLACE_ID/
├── metadata.json
├── newest/
│ ├── latest.json
│ ├── 20260611_0528_00_srv10.json
│ └── 20260611_0507_30_vps01.json
├── relevant/
├── highest_rating/
└── lowest_rating/
| Parameter | Keterangan |
|---|---|
| newest | Ulasan terbaru |
| relevant | Ulasan paling relevan |
| highest_rating | Rating tertinggi |
| lowest_rating | Rating terendah |
curl https://scrapgmap.niteni.web.id/api/status
curl https://scrapgmap.niteni.web.id/api/places
curl https://scrapgmap.niteni.web.id/api/place/0x2e7a8cf009a7d697_0xdd34334744dc3cb
curl https://scrapgmap.niteni.web.id/api/place/PLACE_ID/history/newest
curl https://scrapgmap.niteni.web.id/api/place/PLACE_ID/latest/newest
curl https://scrapgmap.niteni.web.id/api/place/PLACE_ID/file/newest/20260611_0528_00_srv10.json
curl -X POST \
https://scrapgmap.niteni.web.id/api/mine \
-H "Content-Type: application/json" \
-d '{
"url":"GOOGLE_MAPS_URL",
"pages":100,
"sort_type":"newest"
}'
{
"success": true,
"place_id": "0x2e7a8cf009a7d697_0xdd34334744dc3cb",
"sort_type": "newest",
"worker_id": "srv10",
"review_count": 1000,
"file": "20260611_0528_00_srv10.json"
}
curl \ -X POST \ -F "place_id=0x2e7a8cf009a7d697_0xdd34334744dc3cb" \ -F "sort_type=newest" \ -F "worker_id=vps01" \ -F "file=@review.json" \ https://scrapgmap.niteni.web.id/api/upload
{
"success": true,
"place_id": "0x2e7a8cf009a7d697_0xdd34334744dc3cb",
"sort_type": "newest",
"worker_id": "vps01",
"file": "20260611_0507_30_vps01.json"
}
YYYYMMDD_HHMMSS_WORKERID.jsonContoh:
20260611_0528_00_srv10.json 20260611_0507_30_vps01.json 20260611_0912_15_laptop01.json
Setiap node mining dapat memiliki identitas unik:
srv10 vps01 vps02 laptop01 laptop02 windows01Sehingga histori sumber data dapat dilacak.
Generated by Niteni Research Center