Authenticate the User

The user can authenticate via the ClientLogin or using the AuthSub login which is actually more secure. For the ClientLogin, a typical username/password form is used. For the AuthSub login a link is used to send the user to Google to log in. Both are shown below. Normally you would use one or the other.

<form name="loginForm" action="<?php echo $_SERVER['PHP_SELF']; ?>" method="post">
		    <label for="email">Gmail:</label>
		    <input id="email" type="text" name="email" />
		    <label for="password">Password:</label>
		    <input type="password" name="password" id="password"/>
		    <br /><br />
		    <button type="submit" id="submitLogin">Submit</button>
		</form>
        <p><a class="button" href="https://www.google.com/accounts/AuthSubRequest?next=http://www.jensbits.com/demos/ga/app/&scope=https://www.google.com/analytics/feeds/&secure=0&session=1">Or,authenticate using AuthSub through Google.</a></p>

And, of course, the two authentication methods use different http calls to return a token that can be used to access the API.

//ClientLogin: try to log in and get session token for multiple API calls
if(isset($_POST['email']) && isset($_POST['password'])){
	$_SESSION['sessionToken'] = googleLogin($_POST['email'],$_POST['password']);
}
//AuthSub: exchange token for session token so multiple calls can be made to api
if(isset($_REQUEST['token'])){
	$_SESSION['authSub'] = true;
	$_SESSION['sessionToken'] = get_session_token($_REQUEST['token']);
}

//returns sessionToken for multiple calls to API
function googleLogin($email,$passwd){

    $clientlogin_url = "https://www.google.com/accounts/ClientLogin";
     $clientlogin_post = array(
    "accountType" => "GOOGLE",
    "Email" => $email,
    "Passwd" => $passwd,
    "service" => "analytics",
    "source" => "my-analytics"
	);

	$curl = curl_init($clientlogin_url);

	curl_setopt($curl, CURLOPT_POST, true);
	curl_setopt($curl, CURLOPT_POSTFIELDS, $clientlogin_post);
	curl_setopt($curl, CURLOPT_HTTPAUTH, CURLAUTH_ANY);
	curl_setopt($curl, CURLOPT_SSL_VERIFYPEER, false);
	curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1);

	$response = curl_exec($curl);

	preg_match("/Auth=([a-z0-9_\-]+)/i", $response, $matches);
	$sessionToken = $matches[1];

	if (strlen($sessionToken) == 0){
		$sessionToken = "Authentication Failed.";
	}

 	return $sessionToken;
}

//AuthSub returns session token for multiple calls to API
	function get_session_token($onetimetoken) {
		$output = call_api($onetimetoken, "https://www.google.com/accounts/AuthSubSessionToken");

		if (preg_match("/Token=(.*)/", $output, $matches))
		{
			$sessionToken = $matches[1];
		} else {
			echo "Error authenticating with Google.";
			exit;
		}

		return $sessionToken;
	}

Data Requests

Once authenticated to a Google Analytics account and a multi-use session token is acquired, the data requests can be made. The first one will request the profiles (websites) associated with the account. If there is more than one, a dropdown select is populated allowing for the selection of the profile from which to pull data.

$accountxml = call_api($_SESSION['sessionToken'],"https://www.google.com/analytics/feeds/accounts/default");
// Get an array with the available accounts
$profiles = parse_account_list($accountxml);

The call_api function is going to return the XML data from Google based on the request URL sent in. In this case, it is getting the profile data and the parse_account_list function is rolling through that XML and putting the profile data in an array.

//gets the data
function call_api($sessionToken,$url){
	$curl = curl_init($url);

	curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1);
	if (isset($_SESSION['authSub'])){
		$curlheader[0] = sprintf("Authorization: AuthSub token=\"%s\"/n", $sessionToken);
	} else {
		$curlheader[0] = "Authorization: GoogleLogin auth=" . $sessionToken;
	}
	curl_setopt($curl, CURLOPT_HTTPHEADER, $curlheader);

	$response = curl_exec($curl);
	curl_close($curl);

	return $response;
}

//returns accounts list as array
function parse_account_list($xml){
	$doc = new DOMDocument();
	if(stripos($xml,"<") !== FALSE)
	{
		$doc->loadXML($xml);

		$entries = $doc->getElementsByTagName('entry');
		$i = 0;
		$profiles= array();
		foreach($entries as $entry)
		{
			$profiles[$i] = array();

			$title = $entry->getElementsByTagName('title');
			$profiles[$i]["title"] = $title->item(0)->nodeValue;

			$entryid = $entry->getElementsByTagName('id');
			$profiles[$i]["entryid"] = $entryid->item(0)->nodeValue;

			$tableId = $entry->getElementsByTagName('tableId');
			$profiles[$i]["tableId"] = $tableId->item(0)->nodeValue;

			$i++;
		}
		return $profiles;
	} else {
		$sessionToken = "Authentication Failed.";
	}

}

The dropdown of the profile array:

echo "<form name='siteSelect' id='siteSelect' method='post' action='" . $_SERVER['PHP_SELF'] . "'><p><label for='tableId'>Select Site:</label><select name='tableId' id='tableId'>";
		foreach($profiles as $profile)
		{
			if($profile["tableId"] == $table_Id)
				$selected = "selected='selected'";
				echo "<option value='" . $profile["tableId"] . "|" . $profile["title"] . "'" . $selected  . ">" . $profile["title"] . "</option>";
				$selected = " ";
		}
		echo "</select></p>";

The parse_data function below is going to roll through the data returned from Google Analytics and spit out an array that can be used to create the Google Visualization graphs.

//returns data as array
function parse_data($xml){
		$doc = new DOMDocument();
		$doc->loadXML($xml);

		$entries = $doc->getElementsByTagName('entry');
		$i = 0;
		$results = array();
		foreach($entries as $entry)
		{
			$countries[$i] = array();

			$dimensions = $entry->getElementsByTagName('dimension');
			foreach($dimensions as $dimension)
			{
				$results[$i][ltrim($dimension->getAttribute("name"),"ga:")] =  $dimension->getAttribute('value');
			}

			$metrics = $entry->getElementsByTagName('metric');
			foreach($metrics as $metric)
			{
				$results[$i][ltrim($metric->getAttribute('name'),"ga:")] =  $metric->getAttribute('value');
			}

			$i++;
		}
		return $results;
}

Graph Generation

Google Visualizations requires the inclusion of a javascript file in the head tag and empty div’s that will be the target for the graphs:

<script type="text/javascript" src="http://www.google.com/jsapi"></script>

The target div’s should be placed on the page where you want them to appear.

<div id='barchart_div'></div>
<div id='piechart_div'></div>

Finally, the data can be added to the chart generation javascript:

<script type="text/javascript">
      google.load("visualization", "1", {packages:["piechart"]});
      google.setOnLoadCallback(drawPieChart);
      function drawPieChart() {
        var data = new google.visualization.DataTable();
        data.addColumn('string', 'Referrer');
        data.addColumn('number', 'Visits');
        data.addRows(<?php echo sizeof($referrers) ?>);
        <?php
        $row = 0;
        foreach($referrers as $referrer)
		{
		?>
		data.setValue(<?php echo $row ?>,0,'<?php echo $referrer["source"] ?>');
		data.setValue(<?php echo $row ?>,1,<?php echo $referrer["visits"] ?>);
		<?php
		$row++;
		}
		?>

        var chart = new google.visualization.PieChart(document.getElementById('piechart_div'));
        chart.draw(data, {width: 600, height: 440, is3D: true, title: 'Referrer/Visits'});
	  	}

	  google.load("visualization", "1", {packages:["columnchart"]});
      google.setOnLoadCallback(drawBarChart);
      function drawBarChart() {
        var data = new google.visualization.DataTable();
        data.addColumn('string', 'Day');
        data.addColumn('number', 'Visits');
        data.addRows(<?php echo sizeof($visitsgraph) ?>);
		<?php
         $row = 0;
        foreach($visitsgraph as $visits)
		{
		?>
		data.setValue(<?php echo $row ?>,0,'<?php if ($visits_graph_type == "month"){echo date("M", mktime(0, 0, 0, $visits["month"]))." ".$visits["year"];}else{echo substr($visits['date'],6,2)."-".date('M', mktime(0, 0, 0, substr($visits['date'],4,2)))."-".substr($visits['date'],0,4);} ?>');
		data.setValue(<?php echo $row ?>,1,<?php echo $visits["visits"] ?>);
		<?php
		$row++;
		}
		?>
        var chart = new google.visualization.ColumnChart(document.getElementById('barchart_div'));
        chart.draw(data, {width: 700, height: 400, is3D: true, title: 'Visits'});
      }

    </script>

Recommended

Demo

Download zip of all files

If this post helped you out, please consider donating to help pay the hosting fees. 100% of the donations go to the web host.

No related posts.

Google posted a 2-minute video on Google Docs form creation that pretty much sums it up. This has actually been around for a couple of years now but, even though it’s a little late to the party, here is a quick illustration of my jQuery poll done with Google Docs:

Select “Form” from the “Create New” menu.

Fill in the name of the poll or form, short description, and the first question.

Add a question by clicking the “Add Item” button and choose from the menu items. Under “More Actions” you can create the confirmation message and allow the submitters to see the results.

You can also get the embed link for putting the poll right on a web page.

And, you can email the form and have users submit answers right from their email by hitting the “Email this form” button and adding the email addresses.

Here it is in all it’s embedded goodness. Try it out:

No related posts.

First things first…get some data. For simplicity sake, a query object is created and populated within a cfscript tag. In the real world you would pull this from a database.

<cfscript>
bookQuery = QueryNew("LastName,FirstName,Title,ISBN,PurchaseLink");
newRow = QueryAddRow(bookQuery);
QuerySetCell(bookQuery, "LastName", "Clifton" );
QuerySetCell(bookQuery, "FirstName","Brian" );
QuerySetCell(bookQuery, "Title","Advanced Web Metrics with Google Analytics" );
QuerySetCell(bookQuery, "ISBN","0470253126" );
QuerySetCell(bookQuery, "PurchaseLink","<a href='http://www.amazon.com/dp/0470253126?tag=jensbits-20&camp=14573&creative=327641&linkCode=as1&creativeASIN=0470253126&adid=0B10Q2FF6KHJB6ATNA5C&'>Amazon.com</a>" );
newRow = QueryAddRow(bookQuery);
QuerySetCell(bookQuery, "LastName", "Gilmore" );
QuerySetCell(bookQuery, "FirstName","W. Jason" );
QuerySetCell(bookQuery, "Title","Beginning PHP and MySQL: From Novice to Professional, Third Edition" );
QuerySetCell(bookQuery, "ISBN","1590598628" );
QuerySetCell(bookQuery, "PurchaseLink","<a href='http://www.amazon.com/gp/product/1590598628?ie=UTF8&tag=jensbits-20&link_code=as3&camp=211189&creative=373489&creativeASIN=1590598628'>Amazon.com</a>" );
newRow = QueryAddRow(bookQuery);
QuerySetCell(bookQuery, "LastName", "Forta" );
QuerySetCell(bookQuery, "FirstName","Ben" );
QuerySetCell(bookQuery, "Title","Adobe ColdFusion 8 Web Application Construction Kit, Volume 1: Getting Started " );
QuerySetCell(bookQuery, "ISBN","032151548X" );
QuerySetCell(bookQuery, "PurchaseLink","<a href='http://www.amazon.com/gp/product/032151548X?ie=UTF8&tag=jensbits-20&link_code=as3&camp=211189&creative=373489&creativeASIN=032151548X'>Amazon.com</a>" );
</cfscript>

Then a little query of a query so we have data to work with.

<cfquery dbtype="query" name="qryBooks">
SELECT * FROM bookQuery ORDER BY LastName
</cfquery>

Now for the magic. Load up Google’s API script.

 <!--Load the AJAX API-->
    <script type="text/javascript" src="http://www.google.com/jsapi"></script>

And, load the visualization package for what you are creating.

// Load the Visualization API and the table package.
  google.load('visualization', '1', {'packages':['table']});

Set the callback and load the callback function with data. In the drawVisualization function ColdFusion sets the number of rows with the query recordCount and loops through the query records and fills each row with data. The setCell method uses row and column coordinates to set the data. The rows start at 0 (zero) and since ColdFusion likes to start at 1 (one), we have to subtract 1 from the currentRow to get the row correct for the setCell method.

All single quotes need to be escaped. That can be done easily with the ColdFusion Replace function.

Create the table visualization object and call the draw method on it. The allowHtml option is set to true so the links work in the generated table.

  // Set a callback to run when the API is loaded.
  google.setOnLoadCallback(drawVisualization);

  // Callback that creates and populates a data table
  function drawVisualization() {
  	  var dataTable = new google.visualization.DataTable();
  	  dataTable.addColumn('string', 'Last Name');
  	  dataTable.addColumn('string', 'First Name');
  	  dataTable.addColumn('string', 'Title');
  	  dataTable.addColumn('string', 'ISBN');
  	  dataTable.addColumn('string', 'Buy Book');
  	  dataTable.addRows(#qryBooks.recordCount#);

  <cfloop query="qryBooks">
      dataTable.setCell(#currentRow#-1, 0, '#LastName#');
      dataTable.setCell(#currentRow#-1, 1, '#FirstName#');
      dataTable.setCell(#currentRow#-1, 2,'book-title', '#Title#', {style: 'font-weight:bold;'});
      dataTable.setCell(#currentRow#-1, 3, '#ISBN#');
      dataTable.setCell(#currentRow#-1, 4, '#Replace(PurchaseLink,"'","\'","all")#');
  </cfloop>

  //Create the table visualization object and call the draw method on it.
  var table = new google.visualization.Table(document.getElementById('table'));
  table.draw(dataTable, {allowHtml: true});

}

Stick a div in the body as the target for the table.

 <body>

	<!---   Div to hold the table   --->
    <div id="table"></div>

  </body>

You’ll end up with a table with click to sort columns that looks like this:

This example just uses one short page of code so give the Google Visualization API a try. It’s an easy way to show data and trends.

Download code

No related posts.

Enable POP on gmail

First things first. POP access must be enabled on the gmail (or other) account before attempting to download the mail. To enable POP, go to the Forwarding/POP and IMAP panel in Settings. Enable POP and save the settings. Tip: you can reset this and download the same messages again while testing by enabling pop again.

SSL

gmail requires SSL to access it via POP. Unfortunately, the cfpop tag does not include SSL. It can be turned on with the following code:

    <cfset javaSystem = createObject("java", "java.lang.System") />
    <cfset jProps = javaSystem.getProperties() />
    <cfset jProps.setProperty("mail.pop3.socketFactory.class", "javax.net.ssl.SSLSocketFactory") />
    <cfset jProps.setproperty("mail.pop3.port",995) />
    <cfset jProps.setProperty("mail.pop3.socketFactory.port", 995) />

cfpop

Use cfpop wrapped in a cftry surrounded by a cflock to retrieve the emails. POP is slow and may timeout on you if there are lots of messages and lots of attachments. If that is the case, you may want to retrieve just the headers and selectively grab the messages using the UID. This example grabs everything.

<cflock name="cfpop-#form.username#" type="exclusive" timeout="50">

           <cftry>

              <cfpop server="#form.popserver#" username="#form.username#" password="#form.pwd#"
          action="getAll" name="getEmail" attachmentpath="#attachmentFolder#" generateUniqueFilenames="true">

           <cfcatch type="any">
           <h2 class="error">Error Message</h2>
            <p><strong>Type:</strong> #CFCATCH.Type#</p>
            <p><strong>Message:</strong> #CFCATCH.Message#</p>
            <p><strong>Detail:</strong> #CFCATCH.Detail#</p>
            <cfabort>
        </cfcatch>

        </cftry>

</cflock>

Attachments

By default the attachments will be downloaded to the temp directory of the server. You can find out where that is with the GetTempDirectory() function.

<cfoutput>#GetTempDirectory()#</cfoutput>

Or, you could create a folder specifically for the attachments.

<cfset attachmentFolder = ExpandPath("attachments") />

Attachment names and files are tab-separated lists in ColdFusion. Putting these lists in an array makes for easy looping later. Set this up by creating the empty arrays.

<!--- Array for attachment name(s) --->
<cfset attachmentNameArray = ArrayNew(1) />

<!--- Array for attachment file(s) --->
<cfset attachmentFileArray = ArrayNew(1) />

Emails

Looping backwards over the getEmails query returned by cfpop puts the output in the same order as the inbox with the newest message first. The attachments are stuffed in the arrays using the ListtoArray() function and then looped over to display what and where they are.

           <p><strong>Number of Records:</strong> #getEmail.recordCount#</p>
           <p><strong>FYI - TempDirectory:</strong> #GetTempDirectory()#</p>

      <ul>
         <cfloop from="#getEmail.recordCount#" to="1" step="-1" index="i">

                 <li><strong>Row: #i#</strong><br />
                     <em>MessageNumber:</em> #getEmail.messagenumber[i]#<br />
                     <em>UID:</em> #getEmail.UID[i]#<br />
                     <em>From:</em> #getEmail.From[i]# <br />
                     <em>Subject</em>: #getEmail.Subject[i]#<br />
                     <em>Message:</em> #getEmail.body[i]#<br />

                     <cfif Len(getEmail.attachments[i])>
                        <cfset attachmentNameArray = ListtoArray(getEmail.attachments[i], chr(9)) />
                        <cfset attachmentFileArray = ListtoArray(getEmail.attachmentfiles[i], chr(9)) />

                            <em>Attachments:</em><br />
                            <cfloop from="1" to="#ArrayLen(attachmentNameArray)#" index="num">
                                #attachmentNameArray[num]#<br />
                      		</cfloop>

                             <em>Attachment Files Server Location:</em><br />
                             <cfloop from="1" to="#ArrayLen(attachmentFileArray)#" index="num">
                              #attachmentFileArray[num]#<br />
                            </cfloop>

                     </cfif>
                    </li>

         </cfloop>
      </ul>

SSL off

Turn off SSL and it’s all done. SSL may or may not interfere with other processes on the server. Turning it off helps alleviate that.

<!--- Turn off SSL --->
      <cfset jProps.setProperty("mail.pop3.socketFactory.class", "javax.net.SocketFactory") />

Other Pop-enabled Accounts

This example can be used with other pop-enabled accounts. Try it without SSL first then add that in if needed.

cfpop documentation from Adobe

Complete code file

No related posts.

If you don’t own the website that has the material that needs to be removed, don’t bother reading any further. Contact the website responsible for posting it and ask them to remove it.

Cached content is handled through Webmaster Tools. To remove cached content all the steps below are required.

It should be noted that you can could add a meta tag to pages that should not be indexed as such:

<meta name="robots" content="noindex">

or for Google only

<meta name="googlebot" content="noindex">

And for cached pages:

<meta name="robots" content="noarchive">

or for Google only

<meta name="googlebot" content="noarchive">

The meta tag method can be tedious for a large number of files and there is no direct feedback from Google on the removal. For expedited removal and assurance from Google that it has been removed from the search results, follow the steps below.

Step 1: Webmaster Tools

Sign up the site for Webmaster Tools. Webmaster Tools is easy to set up and provides valuable information on Google’s indexing of your site. There are also tools to help you create the robots.txt needed for step 2.

Step 2: Robots.txt

Create a robots.txt file and place it in the root of the website. There are two rules that should be applied in the robots.txt:

User-agent: the robot the following rule applies to
Disallow: the URL you want to block

User-Agent

User-agent allows for the specific selection of search engine robots.

For all search engine bots, the user-agent will be:
User-agent: *

For Google bots use:
User-Agent: Googlebot

All rules under the User-Agent apply to that User-Agent. You can specify rules for individual User-Agents and list them on the same robots.txt.

Disallow

Disallow blocks certain sites, directories, pages, images, or file types.

Block entire site:
Disallow: /

Block directory:
Disallow: /junk-directory/

Block page:
Disallow: /private_file.html

Block specific image from Google image search:
User-agent: Googlebot-Image
Disallow: /images/dogs.jpg

Block all images on your site from Google image search:
User-agent: Googlebot-Image
Disallow: /

Block files of a specific file type (for example, .gif):
User-agent: *
Disallow: /*.gif$

A sample robots.txt to block all files in an include directory might look like this:
User-agent: *
Disallow: /includes/

Rules on the robots.txt can be stacked and as specific as you want. For example, to exclude a directory and file from all search engine bots and images from Google:
User-agent: *
Disallow: /includes/
Disallow: /admin.html

User-agent: Googlebot-Image
Disallow: /

All rules below a User-Agent declaration apply to the User-Agent specified only.

Step 3: Remove URLs/Cached Pages

In Webmaster Tools request the removal of URL from their index. On Webmaster Tools new interface Remove URLs is under Site Configuration, Crawler Access. For the old interface it’s under Tools, Remove URLs.

Select whether URLs, directories/subdirectories, entire site, or cached copies should be removed. Hit “Next” and put in the URL. If you are removing a cached copy and the page still exists, you will need to add a noarchive meta tag.

<meta name="robots" content="noarchive">

If the page no longer exists, select “This page has been modified so that it no longer contains the information that is being cached.”

The removal will be listed as pending until Google successfully removes it. If for some reason it can’t remove the URLs, Google will list the error on this page. Google can remove the URLs in a matter of hours if done correctly. Keep in mind that Google’s documentation states that it can take 3-5 days.

Other search engines will respect the robots.txt but to varying levels. No two search engines are the same and neither is their handling of the robots.txt.

No related posts.