:j@dZddlZddlmZddlmZmZGddZy)an User-Agent Manager This module manages User-Agent strings with random load balancing. It provides thread-safe access to multiple User-Agent strings for web scraping. Key Features: - Random User-Agent selection (default strategy) - Thread-safe User-Agent access - Usage statistics and monitoring - Easy User-Agent list updates - Built-in common User-Agent strings N)List)BalancerStrategyceZdZdZdeefdZdefdZdefdZdefdZ deeddfd Z d eddfd Z d ede fd Z dd ZdefdZdeefdZdefdZde fdZdefdZdefdZdefdZeddZy)Agentsz-User-Agent manager with random load balancing user_agentsc|s td|j|_t|jtj |_tj|_ d|_ y)ziInitialize User-Agent manager Args: user_agents: List of User-Agent strings User agents list cannot be emptyrN) ValueErrorcopyr rrRANDOMbalancer threadingLocklocktotal_requestsselfr s 2/root/.openclaw/workspace/harvester/tools/agent.py__init__zAgents.__init__sT ?@ @&++-!!1!18??C NN$ returnc|j5|xjdz c_|jjcdddS#1swYyxYw)zaGet random User-Agent string Returns: str: Random User-Agent string rN)rrrgetrs rrz Agents.get+sA YY '   1 $ ==$$& ' ' 's /AAc"|jS)zkAlias for get() method for convenience Returns: str: Random User-Agent string rrs rnextz Agents.next5 xxzrc"|jS)zxGet random User-Agent string (explicit method name) Returns: str: Random User-Agent string rrs r get_randomzAgents.get_random=r rNc|s td|j5|j|_|jj |jdddy#1swYyxYw)znUpdate User-Agent strings list Args: user_agents: New list of User-Agent strings r N)r rr r r update_itemsrs r update_agentszAgents.update_agentsEsX ?@ @ YY 9*//1D  MM & &t'7'7 8 9 9 9s ;AA' user_agentc|s td|j5||jvr@|jj||jj |jdddy#1swYyxYw)zdAdd a new User-Agent string Args: user_agent: User-Agent string to add zUser agent cannot be emptyN)r rr appendrr$rr&s r add_agentzAgents.add_agentRsi 9: : YY =!1!11  '' 3 **4+;+;< = = =s AA22A;c(|j5||jvrbt|jdkDrJ|jj||jj |j dddy dddy#1swYyxYw)zRemove a User-Agent string Args: user_agent: User-Agent string to remove Returns: bool: True if removed, False if not found rNTF)rr lenremoverr$r)s r remove_agentzAgents.remove_agent`s~YY T---#d6F6F2G!2K  '' 3 **4+;+;<        sA(B>BBc|j5d|_|jjdddy#1swYyxYw)zReset usage statisticsrN)rrrresetrs r reset_statszAgents.reset_statsps6 YY ""#D  MM   ! " " "s "8Ac|j5|jj}|j|d<|cdddS#1swYyxYw)zRGet usage statistics Returns: dict: Usage statistics rN)rr get_statsr)rstatss rr3zAgents.get_statsvsF YY MM++-E&*&9&9E" #   s +AA cz|j5|jjcdddS#1swYyxYw)z}Get copy of current User-Agent strings list Returns: List[str]: Copy of User-Agent strings list N)rr r rs rget_agents_listzAgents.get_agents_lists2 YY +##((* + + +s1:c,t|jSziGet number of User-Agent strings Returns: int: Number of User-Agent strings r,r rs rcountz Agents.count 4##$$rc2t|jdk(S)zdCheck if User-Agent list is empty Returns: bool: True if list is empty rr9rs ris_emptyzAgents.is_emptys 4##$))rc,t|jSr8r9rs r__len__zAgents.__len__r;rcNdt|jd|jdS)zWString representation Returns: str: String representation z Agents(count=z , requests=))r,r rrs r__str__zAgents.__str__s- s4#3#345[ATAT@UUVWWrc"d|jdS)zbDetailed string representation Returns: str: Detailed representation zAgents(user_agents=rA)r rs r__repr__zAgents.__repr__s %T%5%5$6a88rcgd}||S)zCreate Agents instance with default User-Agent strings Returns: Agents: Agents instance with default User-Agents )zoMozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36zuMozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36zeMozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36zoMozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/137.0.0.0 Safari/537.36zPMozilla/5.0 (Windows NT 10.0; Win64; x64; rv:132.0) Gecko/20100101 Firefox/132.0zuMozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/18.1 Safari/605.1.15zFMozilla/5.0 (X11; Linux x86_64; rv:132.0) Gecko/20100101 Firefox/132.0)clsdefault_agentss rcreate_defaultzAgents.create_defaults >""r)rN)rr)__name__ __module__ __qualname____doc__rstrrrrr"r%r*boolr.r1dictr3r6intr:r=r?rBrD classmethodrIrFrrrrs7 DI "'S'cC 9c 9t 9 =C =D =st " 4 +c+%s%*$*%%XX9#9##rr)rMrtypingrrrrrrFrrrTs! (k#k#r