Encrypted DM reader, batch profiles, liked tweets, more human-like delays

[jackordman]

Summary

Four commits covering encrypted DM support, new scraping capabilities, anti-detection improvements, and bug fixes.

Encrypted DM reader (src/scrapers/twitter/dm.puppeteer.js)

• New Puppeteer-based scraper for encrypted DMs — handles X's passcode gate (both inline and /i/chat/pin/recovery redirect), conversation list scraping, message extraction with sender detection, and media detection
• MCP tools: x_read_dms, x_export_dms, x_get_conversations
• CLI commands: xactions dms list, dms read <username>, dms export with interactive passcode prompt and optional save
• Sender detection via background color heuristics (dark mode) with horizontal alignment fallback
• skipNavigation optimization avoids redundant /messages navigation in export loops
• Handles both /i/chat (new Tailwind UI) and /messages (legacy) DOM structures

Batch profile scraping (x_get_profiles)

• New MCP tool for fetching multiple profiles in a single call
• Human-like delays between navigations to avoid robotic browse patterns

Liked tweets scraping (scrapeLikedTweets)

• New scrapeLikedTweets() scraper with optional username (auto-resolves from config or sidebar)
• x_get_likes MCP tool wired to use it as single source of truth
• Return shape standardized to { likedTweets, count, username }
• Removed from xeepyTools, removed redundant double-wrapping in server handler

Human-like delays and anti-detection

• Replace uniform random delays (1-3s) with log-normal distribution (2-7s) plus ~8% distraction spikes (8-20s) across scrapers and MCP local-tools
• Deduplicated randomDelay in local-tools.js — now imported from scrapers module

Auth and reliability fixes

• checkAuth() post-navigation guard for bookmarks and likes scrapers
• Auto-login in MCP ensureBrowser() when XACTIONS_SESSION_COOKIE is set
• Fix browser hang on auth failure with try/finally in unified scrape()
• Resolve and save username on xactions login, clear on logout

Restored missing client files

• Restore parsers.js, search.js, trends.js, TwoFactorAuth.js, DEFAULT_FIELD_TOGGLES — were deleted but still imported, breaking MCP server startup

Test plan

• x_get_conversations — returns conversations with names + handles
• x_read_dms — returns messages with sender detection, text, time, media
• x_export_dms — loops multiple conversations via skipNavigation
• x_get_likes — returns wrapped object, no double-wrapping
• CLI dms list/read/export --help parses correctly
• All modules load: dm.puppeteer.js, local-tools.js, server.js, CLI
• Existing unit tests pass (221/222, 1 pre-existing failure in HTTP DM sendDM test)

[vercel]

@jackordman is attempting to deploy a commit to the aryllyraaryl-6220's projects Team on Vercel.

A member of the Team first needs to authorize it.

[nirholas]

Thank you! Will get to these as soon as i can. Looks great from what I saw at first glance. I appreciate it.