Download HTML

[pcurtis]

Dear All,

I can download a web pages HTML WITH THIS

Code: Pascal  [Select][+][-]

1. function TForm1.SynapseDownload(URL: string): string;
2. var
3.   HTTPGetResult: Boolean;
4.   HTTPSender: THTTPSend;
5.   S: string;
6. begin
7.   Result := '';
8.   HTTPSender := THTTPSend.Create;
9.  
10.   HTTPSender.Timeout:=10000;
11.  
12.   HTTPGetResult := HTTPSender.HTTPMethod('GET', URL);
13.  
14.   SetLength(S, HTTPSender.Document.Size);
15.   HTTPSender.Document.Read(S[1], Length(S));
16.   Result:=S;
17.  
18.   HTTPSender.Free;
19. end;
20.  

I have two questions

1. How can I tell the web server what browser I am (user agent)? For example "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:81.0) Gecko/20100101 Firefox/81.0"

2. Can I fool the web server into thinking I followed a link on one of it's pages?

Thanks in advance.

[Handoko]

1. How can I tell the web server what broswer I am?

Set the user agent property:
http://synapse.ararat.cz/doc/help/httpsend.THTTPSend.html#UserAgent

These are the common user agent strings:
https://www.networkinghowtos.com/howto/common-user-agent-list/

More about user agent:
https://en.wikipedia.org/wiki/User_agent

For example:
HTTPGetResult.UserAgent := 'Mozilla/5.0 (compatible; fpweb)';

[pcurtis]

Cheers. Again 

[Handoko]

2. Can I fool the web server into thinking I followed a link on one of it's pages?

Not very sure but I believe it has something to do with HTTP referer:
https://en.wikipedia.org/wiki/HTTP_referer

HTTP referer is a field in the Headers property:
http://synapse.ararat.cz/doc/help/httpsend.THTTPSend.html#Headers

[pcurtis]

Thanks again.