How to programatically access another web site's form and get the data?


I need to write a script that will send a POST to a web site's form and then accept the CSV file that it will return.  I can go onto the web site and enter my username, password and a month from a drop down to get a CSV file of data but I would like to program a web form on my Admin site that will do this for me by pressing a button as I want to process the results and add to a database.

Any thoughts on how to start?


2/26/2009 11:24:37 PM 93655 articles. 5 followers. Follow

2 Replies

Similar Articles

[PageSpeed] 3

Well sounds like what you need to start is creating an object of this login screen, pressing the login button and then changing the drop down to the correct month.. WHICH IS NO SMALL TASK  and very easy to give up on.

Actually i have already given up on answering this Big Smile

To do this, create an iFrame of the URL you need to login to, and fill in the user\pass through javascript and submit the form. Because this is inside of an iFrame you can hide the frame all together with some simple styles. Then once the page is loaded.. Not sure how to do this, maybe a setTimeOut() to an X amount of seconds which is > to the amount of seconds it typically takes to load. Then simply change this 'dropdownbox' to the correct value and submit the form again.

Then it gets tricky cause as you state a csv file url will be prompted back. Here you need to capture this url and then send a server postback to intiate an event that builds a WebClient to recieve the the csv file as binary data. Once recieved you can save it to the hard disk and read it as a CSV file.

 Now that was exhausting.

To be honest this is going to be EXTREMELY difficult and the best person for the job is someone to download it everyday and import it to your website.


Thats my two cents.



Please mark post as answer - Progressive Web Methodologies

My Blog
2/26/2009 11:45:18 PM

 You might be able to use WaTiN from

Don't forget to click "Mark as Answer" on the post that helped you.
This credits that member, earns you a point and marks your thread as Resolved so we will all know you have been helped.
3/1/2009 9:11:46 PM

Similar Artilces:

synchronizing chunk of data of one web form for another web form
I'm making a web application. In one web form; i'm taking inputs from user. Now; there is some info given by user in this page which is needed for web form which is going to be displayed next. i want to display that info automatically on that web form so that user doesn't have to re-input that info in this next web form. Info from first page would be inserted into database when user clicks on the submit button. then that next web form would be displayed. and the chunk of info from previous page should be displayed there!!! how can i do this?? cany anybody help?? nobody can help me!! I...

Access Web Control's property within the Web Form
Hello, I have a Web Control which has a TextBox and a Button. I want to put this Control on a WebForm, then put some text in a Control's TextBox, press on Control's Button and be able to access text box's value from within the Web Form. That's my Control: _________________________________________________ public class Colo : System.Web.UI.UserControl { protected System.Web.UI.WebControls.TextBox TextBox1; protected System.Web.UI.WebControls.Button Button1; public string Myval{ get{return (string)ViewState["myval"];} set{ViewState["myval"] = va...

how can you display another web site's web page in your web page without leaving your site
Can you display another web site's web page in your web page without leaving your site? I know you could use a frameset with .asp, but it looks like Visual Web Delevoper 2005 does not have any controls to setup a frameset. Any help, that would point me in the right direction would be great. Thanks Patrick     With screen scraping 4GuysFromRolla.Com: Screen Scrapes in ASP.NET,Teemu KeiskiFinland, EU Thank you. This information was a great help!!! Thanks again Patrick...

Web Form embedded in another Web Form
Hi,  I have programmed a Web Form which acts like a scientific calculator. I would like to embedd this calculator in the upper left hand corner of another accounting Web Form. I don't want to host the calculator on the same server as the accounting page. I.e. I want them to have distinct URLs. Classically, I would do this using frames, but is there a better way using ASP? Is there some sort of Panel which can display the webpage at a specific URL which I can just drag onto my accounting Web Form? Thanks,  P1000   Frames are the only way to embed a webform inside ano...

calling a web form from another web form
I would like to know what is the best way to open a web form from another web form. I would like to call it from a button control. Thanks Well, if I've grasped your question right, there are many methods to do that: 1)Response.Redirect > To navigate to another page from code and is equal to clicking a hyperlink. I suggest this as I think it's closer to your question. 2)Server.Transfer > This ends the current web form and begins a new web form. It's usable when you want to pass some variables i.e (Label1.Text) to the next immediate page. It's not safe though and not used to send p...

For interrupting.web form Resized by position of the div : if div can't dispaly all (such as only top part , then web form heithten the heght),resize the web form
Web Form Resized by position of the div : if div can't dispaly all (such as only top part , then web form heithten the heght),resize the web form ! Because of my pool English, if you can't see , I will explain more ! ThanksGambler is the real life I guess you mean when form grows it also grow parent div element. This is normal. If you want div to stay fixed size and rather clip the form and maybe show a scrollbar, look at overflow property in CSS.Thanks------------------------------------------------------------This posting is provided "AS IS" with no warranties, and confers no ...

Passing Values from a Web Form to Another Web Form
Hello All! I am trying to pass values from one web form to another web form. I know that there are 3 ways of doing this: queryString, Server.Transfer and Session. I am using the Server.Transfer method. But I am not able to create, in my 2nd web form, an instance of my 1st web form. My 1st Web form is named CallTrack.aspx and my 2nd is named Export.aspx. What I mean is something like this: Public value as CallTrack. I can't create it in my 2nd web form because when the intellisense is displayed, there's no CallTrack in the options. Thanks!   How about using cross-...

How to access a control on a web form from anoter web form
hi all I have this scenarios i have two web forms, one called form1 and the other called form2 form1 has a label with id "lbl1" is it possible to access lbl1 from form2, change its text permenantly? thanks.   refer: remember to click "Mark as Answer" on the post that helps you. MinaSamy: hi all I have this scenarios i have two web forms, one called form1 and the other called form2 form1 has a label with id "lbl1" is it p...

Accessing two web forms in a single web form
  Hi. I am developing a website in VS 2005 with Ajax & SQL Server. I am having 5 forms in my application. 1) Login Form 2) Main form 3) Form "A" 4) Form "B" I need to show the main form after the User login. I need to show all the contents of form A or form B (Ex: Form "A" user or form "B" user) in the Main Page. Can I show a single page having Main Form controls as well as Form "A" and Form "B" controls? I should access all the controls including Form A/B in the Main Page. Thanks ...

can someone one give me difference between web form and mobile web form and which or where or when i'm using the forms?
thanks Marc Hi Marc, Based on my understanding, you want to know the differences between the ASP.NET web application and ASP.NET mobile web application. If I have misunderstood you, please feel free to let me know. The ASP.NET forms are used to develop the ASP.NET pages for desktop browsers and The ASP.NET mobile forms are used to develop the ASP.NET pages for mobile device browsers. When we create the ASP.NET mobile web forms pages, we can use nearly all the features of ASP.NET. But there are a couple of compatibility issues: Error Handling and Reporting. Tracing. Using Redi...

Submitting data from a know web form to unknown web form
hi i m making a software in which i will submitt some data from a web page that will go to a web form of which contrlos are unknown to me only i know the name and how many controls in that form it means i can see the form only. how can i do this please help me soon with code plz its very argent.i m doin this wit the help of foxtrot.xray.WebRobot but its giving me error that this dll file is already exists in The file ('C:\Program Files\Microsoft Visual Studio 8\Common7\IDE\_foxtrot.xray.WebRobot.dll' already exists).i don know what will do so please help me soon please thanks praveen We ca...

How to Access/Pass Server Side Array Variable at Another Web Form's Client Side
Hi All,I struck up with some intrested senario at my application development...hope some body will guide me or sends me some code snippets....Thanks in advance.Senario is like A.aspx (using C# .net 2.0 as code behind) I am going to have a array variable basically it is an TWO Dimensional array after populating the values in array I need to redirect/ reload another web form B.aspx, here i need to access the array in B.aspx client side JavaScript.How can I do this...Thanks AgainRaju Dont do a redirect but use server.transfer. That way the previous page will still hold its value, ...

Is it secure to provide access to a web form to display data from a device attached to server's serial port
Hello there!  I am developing an web application that enables a user to view data from a device attached to the com/usb port at the server side. I know I can use System.IO to communicate with the device from the page. But what I am not sure is the security issues involved with this kind of implementation. I have read some posts from this site,  but im not able to come to a conclusion. Is it safe to allow a site users to view data from the device directly on web form? Should I consider some other option? Can anyone help me on this?  I would really appreciate any hel...

How to Make Web Forms from other Web Forms
In putting together an ASP.NET application for a biz application, we have come to the point where there are three different types of basic forms which have, for the most part, been perfected. Now its is a matter of cloning those forms for various uses and modifying or adding code to suit the particular need. Copy and paste works OK, but there is a lot of changing of certain words, etc. Is there a way in ASP.NET to take these basic forms, turn them into classes or templates, create forms from them, then add or overwrite code? ? (Anybody who is a Vis Fox Pro programmer would know imme...

Web resources about - How to programatically access another web site's form and get the data? -

Programatically assigning a Customer Group in Magento
... or thousands. The Customer Group might change because you want the specific customer to be in a different group, or you might want to programatically ...

Authentication - LinkedIn Developer Network
Authentication Wed, 01/12/2011 - 12:12 — LIDeveloperAdmin LinkedIn Authorization When your application acts on behalf of our members, it's important ...

User plod - Stack Overflow
Stack Exchange log in - careers - chat - meta - about - faq Stack Overflow Questions Tags Users Badges Unanswered Ask Question plod less info ...

Pipeline (Unix) - Wikipedia, the free encyclopedia
In Unix-like computer operating systems (and, to some extent, Microsoft Windows ), a pipeline is the original software pipeline : a set of processes ...

okTravel's Data Sources
Features information of where okTravel gets its data, and maybe even why certain data sources were chosen over others.

Text Readability Scores - Web Development in Brighton - Added Bytes
hi! neat script! the layout seems to be broken, though. I get loads of whitespace between the input box of the script and your last paragraph. ...

Startup News: Save Amit, and Hm, Not Too Many Launches Last Week
CONQUER THE WORLD. Startup Weekend just closed a partnership with the Kauffman Foundation ; now it’s announced a two-year agreement with Google ...

Blippy / The Blippy Blog
The Official Blog

On designing UIs for non-robots
In a typical, attentive human subject, the usual latency between a visual stimulus and a voluntary motor response is between 100 and 300 milliseconds. ...

DDS Hands On « Bulldozer00's Blog
Introduction In 2009, I downloaded RTI Inc.’s Data Distribution Service (DDS) communication middleware software developer kit along with a free ...

Resources last updated: 11/30/2015 11:28:44 AM