o dtwi/@sddlZddlZddlZddlZddlZddlmZddlZe e Z ej ej ej eddZddZddZed d d dddZdddZddZdS)N)retry..z settings.jsoncCs6t|trt|dks|std|dSdS)N zInvalid ASIN format: FT) isinstancestrlenisalnumloggererror)asinr 0/var/www/agentarbitrage/keepa_deals/keepa_api.py validate_asinsrc Cstdd|}ddi}ztj||dd}||}td||WStjjyF}ztd|WYd }~d Sd }~wt y`}ztd |WYd }~d Sd }~ww) zQ Makes a request to the /token endpoint to get the current token status. z-Requesting current token status from Keepa...z https://api.keepa.com/token?key= User-Agent>Mozilla/5.0 (Windows NT 10.0; Win64; x64) Chrome/90.0.4430.212headerstimeoutz%Successfully retrieved token status: zFailed to get token status: Nz9An unexpected error occurred while getting token status: ) r inforequestsgetraise_for_statusjson exceptionsRequestExceptionr Exception)api_keyurlrresponsedataer r r get_token_statuss$  r"i)stop_max_attempt_number wait_fixedFcCsdt|}t|}td|d||r td|jddtjtjtjt dd}z!t |d }t |}Wd n1sFwYtd Wn^t t jfytd id |d ddgddgddgdddgdddgdddgdddgd dd!d"d#d"d$d"d%d"d&d'd(d)d*d)d"d)d"d"d"d"|d+gd,d- }Ynw||d <||d.<t j|d/d)d0}tj|} d1|d2| } d3d4i} z;tj| | d5d6} | | } | d7id8g}| d9d:}| d;}td|| ||fWStjjy}zx|jr |jjnd }d:}d }|jd urWz|j }|d9d:}|d;}|rJ|d urJ||Wn t jyVYnw|d?ksd|ro|d@krotdA|dB|tdC|pvdDdE|jr|jjn|d ||fWYd }~Sd }~wty}ztdFt |WYd }~dGSd }~ww)Hac Fetches deals from the Keepa API using a fixed, user-provided query. The `use_deal_settings` parameter is ignored to ensure stability. Accepts a page number and a sort_type. Optional: token_manager instance to handle rate limiting and token bucket waits. Returns the response data, tokens consumed, and the number of tokens left. z4Executing fetch_deals_for_deals (v_fix_sort). Page: z, Sort: zJTokenManager provided. Checking/Waiting for tokens before Deal API call...r)estimated_costrzkeepa_query.jsonrNz'Using Keepa query from keepa_query.jsonzFkeepa_query.json not found or invalid. Using hardcoded fallback query.pagedomainId1excludeCategoriesincludeCategoriesiR priceTypes deltaRangeii&deltaPercentRange2isalesRankRangeiPi` currentRangeiiu minRatingisLowestF isLowest90 isLowestOffer isOutOfStock titleSearchisRangeEnabledTisFilterEnabledr#)r/r#r&) filterEroticsingleVariation hasReviewsisPrimeExclusivemustHaveAmazonOffermustNotHaveAmazonOffersortType dateRangewarehouseConditionsrE),:) separators sort_keyszhttps://api.keepa.com/deal?key=z &selection=rr<rdealsdrtokensConsumedr tokensLeftzFetched z deals. Tokens consumed: . Tokens left: iz'Deal fetch failed with retryable error z!. Re-raising for retry decorator.zDeal fetch failed: N/Az, zDeal fetch exception: )NrN)!intr rrequest_permission_for_callospathjoindirnameabspath__file__openrloadFileNotFoundErrorJSONDecodeErrorwarningdumpsurllibparsequoterrrrrrr status_codeupdate_after_callr textrr)r)ruse_deal_settings sort_type token_managerKEEPA_QUERY_FILEf deal_query query_jsonencoded_selectionrrrr rMtokens_consumed tokens_leftr!re error_datar r r fetch_deals_for_deals*s         !" 9          ,rsmcCsJ|stddddiddfStdt|dd|dd d d|}d |d |d |d|d|d|d|d}ddi}z1tj||dd} | | } | dd} | d} td| d| ddi} | | | | fWStj j y}zp|j dur|j j nd}t dd|dd d|dt|d}d}|j durz!|j }|dd}|d}|dkrt d |d!|Wntjytd"|d#Ynwd|i}d|||fWYd}~Sd}~wty$}z$t d$d|dd d%t|dd&i}d|ddfWYd}~Sd}~ww)'z Fetches a batch of products from the Keepa API. Returns the response data, API info, tokens consumed, and tokens left. Optimized for the upserter task by default. z7fetch_product_batch called with an empty list of ASINs.Nerror_status_codeEMPTY_ASIN_LISTrzFetching batch of z ASINs: rHr#z...z"https://api.keepa.com/product?key=z&domain=1&asin=z&stats=z&days=z&offers=z&rating=z &history=z&only_live_offers=1rrxrrOrPz,Batch API call successful. Tokens consumed: rQrSz"HTTP Fetch failed for batch ASINs z... with status : rRz429 ERROR. Keepa reported z4 tokens consumed for this failed call. Tokens left: HTTP error response (status ) was not valid JSON.z%Generic Fetch failed for batch ASINs z...: GENERIC_SCRIPT_ERROR)r r`rrrXrrrrrrrrer rr_r)r asins_listdaysoffersratinghistorycomma_separated_asinsrrrr rprqapi_infor!retokens_consumed_on_errortokens_left_on_errorrrapi_info_on_errorr r r fetch_product_batchsR * 0  .    (rc Cs|stddddiddfSt|dkr(tdt|dddd iddfSd |}td t|d d |d|}ddi}z1tj||dd}|| }|dd}|d}td|d|ddi} || ||fWStj j y} zd| j dur| j j nd} td| d| d} d} | j durz!| j }|dd} |d} | dkrtd| d| Wnt jytd| dYnwd| i}d|| | fWYd} ~ Sd} ~ wty } ztjd| d d!dd"i}d|ddfWYd} ~ Sd} ~ ww)#z Fetches data for a list of sellers from the Keepa API. Returns the response data, API info, tokens consumed, and tokens left. z,fetch_seller_data called with no seller_ids.NrwEMPTY_SELLER_ID_LISTrdz)fetch_seller_data called with a batch of z which is over the 100 limit.BATCH_SIZE_EXCEEDEDrHzFetching data for batch of z sellersz!https://api.keepa.com/seller?key=z&domain=1&seller=rrrLrrOrPz-Seller API call successful. Tokens consumed: rQrSz/HTTP fetch failed for seller batch with status rzrRz*429 ERROR on seller batch. Keepa reported z tokens consumed. Tokens left: r{r|z9An unexpected error occurred while fetching seller data: T)exc_infor})r r`rr rXrrrrrrrrrer_r)r seller_idsseller_ids_strrrrr rprqrr!rerrrrrr r r fetch_seller_datasX         r)Fr&N)rtrurvr)loggingrrrV urllib.parserbretryingrtime getLogger__name__r rWrXrYrZr[ SETTINGS_PATHrr"rsrrr r r r s        5