html - xpath finds element in developers console but not in scrapy.response -
i'm trying scrape price first ticket here page using xpath:
'.//*[@class="price"]/text()'
this works in developer's console, not when run in scrapy shell using response.xpath. have tried following in shell:
'.//*[@class="initial"]/div[@class="price"]/text()'
and
'//*[@id="tvb901769989"]/div[1]/div[4]'
(although don't think id property can used in shell this).
is there wrong xpaths i've used, or there thing different way page works? appreciated. thanks!
this happens because checking @ different requests, page see doesn't have information need inside file, gets dynamically, in case from: www.vividseats.com/javascript/tickets.shtml?productionid=1771684
there can check prices on json format, think 1 item:
{ "s":"section 111", "r":"8-22", "q":"4", "p":"692.00", "i":"vb782041491", "d":"111", "n":"zone seating. seller committing procure these tickets upon receipt of order. after place order , order confirmed, guarantee tickets within listed zone or section listed or 1 comparable , receive these tickets in time event or money back. orders exceeding 4 tickets may split different rows within requested zone or section.", "f":"0", "l":"section 111", "g":"0", "e":"0", "h":"07/21/15", "t":"0", "v":"", "c":"84352", "z":"1", "rhdn":"0", "ind":"0", "sd":"0" }
where p
contains price.
Comments
Post a Comment