Why is this returning a "Not Found" with PHP and cURL? -

-

my script works other links tried, , same response curl (and lot smaller, code):

<?php     $url = $_get['url'];     $header = get_headers($url,1);     print_r($header);     function get_url($u,$h){         if(preg_match('/200/',$h[0])){             echo file_get_contents($u);         }         elseif(preg_match('/301/',$h[0])){             $nh = get_headers($h['location']);             get_url($h['location'],$nh);         }     }     get_url($url,$header); ?>

but for: http://www.anthropologie.com/anthro/catalog/productdetail.jsp?subcategoryid=home-tabletop-utensils&id=78110&catid=home-tabletop&pushid=home-tabletop&popid=home&sortproperties=&navcount=355&navaction=top&fromcategorypage=true&selectedproductsize=&selectedproductsize1=&color=sil&colorname=silver&isproduct=true&isbigimage=&templatetype=

and: http://www.urbanoutfitters.com/urban/catalog/productdetail.jsp?itemdescription=true&itemcount=80&startvalue=1&selectedproductcolor=&sortby=&id=14135412&parentid=a_furn_bath&sortproperties=+subcategoryposition,&navcount=56&navaction=poppushpush&color=&pushid=a_furn_bath&popid=a_decorate&prepushid=&selectedproductsize=

(and anthropologie product links). i'm assuming other sites have no yet found act way also. here header response:

array (     [0] => http/1.1 200 ok     [server] => apache     [x-powered-by] => servlet 2.4; jboss-4.2.0.ga_cp05 (build: svntag=jbpapp_4_2_0_ga_cp05 date=200810231548)/jbossweb-2.0     [x-atg-version] => version=rentlufeqyxbvedqbgf0zm9ybs85ljfwmsxbremgwybeufnmawnlbnnllzagif0=     [content-type] => text/html;charset=iso-8859-1     [date] => sat, 24 jul 2010 23:47:47 gmt     [content-length] => 21669     [connection] => keep-alive     [set-cookie] => array         (             [0] => jsessionid=65ca111adbf267a3b405c69a325576f8.app46-node2; path=/             [1] => visitcount=1; expires=fri, 29-may-2026 00:41:07 gmt; path=/             [2] => uoccii:=; expires=mon, 23-aug-2010 23:47:47 gmt; path=/             [3] => lastvisited=2010-07-24; expires=fri, 29-may-2026 00:41:07 gmt; path=/         )  )

i'm guessing maybe has cookies? ideas?

install fiddler , see being sent.

you can try setting user-agent real browser. sites try prevent scraping checking this.


Comments

Post a Comment

Popular posts from this blog

c++ - How do I get a multi line tooltip in MFC -

-
right now, have tool tip pops when hover on edit box. problem tool tip contains multiple error messages , in 1 long line. need have each error message on own line. error messages contained in cstring new line seperating them. my existing code below. bool ontooltiptext(uint, nmhdr* pnmhdr, lresult* presult) { assert(pnmhdr->code == ttn_needtexta || pnmhdr->code == ttn_needtextw); // need handle both ansi , unicode versions of message tooltiptexta* pttta = (tooltiptexta*)pnmhdr; tooltiptextw* ptttw = (tooltiptextw*)pnmhdr; // tchar szfulltext[256]; cstring strtiptext=_t(""); uint nid = pnmhdr->idfrom; if (pnmhdr->code == ttn_needtexta && (pttta->uflags & ttf_idishwnd) || pnmhdr->code == ttn_needtextw && (ptttw->uflags & ttf_idishwnd)) { // idfrom hwnd of tool nid = ::getdlgctrlid((hwnd)nid); } //m_errprojaccel[ch] contains 1 or more error messages each...
Read more

asp.net - In javascript how to find the height and width -

-
i having .aspx , masterpage page. in masterpage loading aspx page . in aspx page design using generating table structure using code-behind server in javascript how find height , width . regards, kumar if you're looking table height , width, should it var tbl = document.getelementbyid('tbldemo'); alert(tbl.offsetwidth + '\n' + tbl.offsetheight);
Read more

c# - DataTable to EnumerableRowCollection -

-
i have datatable according client requirement can contain invalid date "00/00/1999",null,empty string.(typed datset) when collect them enumerables wish convert of invalid forms empty string. (i.e) enumerablerowcollection<datarow> query = order in _table.asenumerable() select new { orderdate= string.isnullorempty(convert.tostring(order.field<datetime>("orderdate")) || (how check date invalid date) ? string.empty : order.field<datetime>("orderdate") } how check whether date valid date or not? datetime.tryparse...like given current code: datetime date; enumerablerowcollection<datarow> query = order in _table.asenumerable() select new { orderdate= string.isnullorempty(convert.tostring(order.field<datetime>("orderdate")) || !datetime.tryparse(convert.tostring(order.field<datetime...
Read more