<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>WMpS Blog - Surfing The Digital Wave &#187; Website Analysis</title>
	<atom:link href="http://www.wmps.com/blog/website-analysis/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.wmps.com/blog</link>
	<description>Just another WordPress weblog</description>
	<lastBuildDate>Fri, 10 Sep 2010 08:36:24 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.1</generator>
		<item>
		<title>Mobile Analytics Tracking: Challenges and Solutions</title>
		<link>http://www.wmps.com/blog/website-analysis/web-analytics/mobile-analytics-tracking-challenges-and-solutions/</link>
		<comments>http://www.wmps.com/blog/website-analysis/web-analytics/mobile-analytics-tracking-challenges-and-solutions/#comments</comments>
		<pubDate>Wed, 01 Sep 2010 08:34:35 +0000</pubDate>
		<dc:creator>Wei Shao</dc:creator>
				<category><![CDATA[Web Analytics]]></category>
		<category><![CDATA[analytics]]></category>
		<category><![CDATA[coremetrics]]></category>
		<category><![CDATA[google analytics]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=2185</guid>
		<description><![CDATA[Thanks to the iPhone and Android, the smart phone market has been boosted since last year. According to a report from market researcher IDC, shipments of smart phones in the first quarter of 2010 grew to 54.7 million units, a 56.7% increase over the first quarter of 2009. As a result, internet usage via mobile [...]]]></description>
			<content:encoded><![CDATA[<p>Thanks to the iPhone and Android, the smart phone market has been boosted since last year. According to a report from market researcher IDC, shipments of smart phones in the first quarter of 2010 grew to 54.7 million units, a 56.7% increase over the first quarter of 2009. As a result, internet usage via mobile phones has been steadily increasing.  The mobile web grew 110% in the U.S. last year and 148% worldwide as measured by growth in pageviews. To fully realize the potential of today’s mobile world, e-businesses are rapidly developing mobile sites and mobile content to serve an ever growing population of mobile users. It also means these companies must be prepared to exploit the latest web analytics technology to measure their mobile sites and improve their performance. However, unlike standard web analytics, mobile analytics tracking faces many challenges and needs different tracking methods to guarantee the best quality of data is captured.</p>
<h3>Data Collection Challenges</h3>
<p>The current web analytics data collection is based on JavaScript. The JavaScript initiates a 1px image request to an analytics service provider and the relevant information desired for an understanding of the visitor behaviour is sent along with the image request. Among the information gathered is both a persistent and a session cookie. However, although some smart phones like iPhone and Android do support JavaScript, there still are hundreds of different kinds of devices in the markets and most of them don’t support JavaScript yet.</p>
<p>Another issue is cookie support. If you use different analytics tools to measure your mobile site at the same time, you will be surprised by the results.  Two different tools can return totally different unique visitor numbers. These differences are because many mobile devices don’t support cookies and analytics vendors have different ways to identify mobile unique visitors.</p>
<h3><a href="http://www.wmps.com/blog/wp-content/uploads/2010/09/mobile-analytics.jpg" rel="lightbox[2185]"><img class="aligncenter size-medium wp-image-2187" title="mobile analytics" src="http://www.wmps.com/blog/wp-content/uploads/2010/09/mobile-analytics-300x143.jpg" alt="mobile analytics" width="300" height="143" /></a></h3>
<h3>Bypassing the issues</h3>
<p>In order to combat the issue that some low-end mobile devices don’t currently support JavaScript execution, we have to send the image request manually instead of calling preset JavaScript methods. Fortunately, Google Analytics provides a smart solution by calling the server side snippet solution instead of sending ugly image request query string parameters. Google has pre-defined the image request server script in the most popular languages such as PHP, JSP and .Net. Users just need to download the preset script file and put a tracking snippet on the mobile site to call the pre-defined file. You can download the pre-defined file from <a href="http://code.google.com/mobile/analytics/download.html">Google Code</a>, and then put the following snippet (PHP Version) at the end of your mobile site:</p>
<pre>&lt;?php
  $googleAnalyticsImageUrl = googleAnalyticsGetImageUrl();
  echo '&lt;img src="' . $googleAnalyticsImageUrl . '" /&gt;';
?&gt;</pre>
<p>Unfortunately, many analytics vendors, including Google Analytics, haven’t provided any solution to bypass the cookie support issue. As a result, Google Analytics always counts a mobile visit as a unique visitor and displays inflated figures. In order to get correct visitor information, we need the persistent visitor ID. Some enterprise analytics vendors, such as Coremetrics, allow the users to send extra query string values with each tag to associate it with both a session and a cookie ID.  The cookie ID source value will be persistent and based on a value defined within the device and accessible via API or OS layer to the code generating the image request. And the session ID could be randomly generated with each device session or generated using a device session value. As a result, Coremetrics could be able to identify new visitors or repeat visitors.</p>
<h3><a href="http://www.wmps.com/blog/wp-content/uploads/2010/09/coremetrics-screenshot.jpg" rel="lightbox[2185]"><img class="aligncenter size-full wp-image-2186" title="coremetrics screenshot" src="http://www.wmps.com/blog/wp-content/uploads/2010/09/coremetrics-screenshot.jpg" alt="" width="300" height="159" /></a></h3>
<h3>Pitfalls of Current Mobile Analytics Tracking</h3>
<p>Again, like standard web analytics, the data collected from analytics vendors is not 100% accurate. The cookie IDs generated by the device API are not always stable, and manually sending image requests do not support some high level analytics functionality such as event tracking in Google Analytics and Marketing tracking in Coremetrics.   With increasing popularity of mobile usage and high demands of accurate data, I think more improvements will be made in the near future.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/web-analytics/mobile-analytics-tracking-challenges-and-solutions/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Fashion vs. Usability</title>
		<link>http://www.wmps.com/blog/website-analysis/usability/fashion-vs-usability/</link>
		<comments>http://www.wmps.com/blog/website-analysis/usability/fashion-vs-usability/#comments</comments>
		<pubDate>Thu, 19 Aug 2010 13:56:27 +0000</pubDate>
		<dc:creator>Clare Blunt</dc:creator>
				<category><![CDATA[Usability]]></category>
		<category><![CDATA[ecommerce website]]></category>
		<category><![CDATA[website design]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=2073</guid>
		<description><![CDATA[There are a number of new, innovative merchandising and website design tools entering the market at the minute, all claiming to be the next ‘big thing’. It’s sometimes hard to differentiate between brands and competitors online, especially in an industry such as the fashion retail market. But some brands are trying. The likes of Whistles [...]]]></description>
			<content:encoded><![CDATA[<p>There are a number of new, innovative merchandising and website design tools entering the market at the minute, all claiming to be the next ‘big thing’. It’s sometimes hard to differentiate between brands and competitors online, especially in an industry such as the fashion retail market. But some brands are trying. The likes of Whistles and River Island have tried to stand out from the crowd with flash heavy, visually focused websites. In an industry where style in everything it’s easy to understand why some brands might get carried away with making their website as visually striking and unique as possible. But much like a dress made of newspaper, there has to be a compromise between eye-catching design and practicality.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/08/newspaper_dress.gif" rel="lightbox[2073]"><img class="aligncenter size-medium wp-image-2074" src="http://www.wmps.com/blog/wp-content/uploads/2010/08/newspaper_dress-222x300.gif" alt="" width="222" height="300" /></a></p>
<p>It’s important not to forget that ecommerce is still a relatively new concept, and it’s taken many months to persuade consumers that shopping online can be as easy (if not easier!) and as engaging as shopping in store. By making visually appealing, flash focused websites some brands are forgetting the usability aspect of online shopping, and making the online customer experience a lot harder and frustrating than shopping in store.</p>
<h2><strong>What makes a good ecommerce website?</strong></h2>
<p>There needs to be a compromise between attractive, eye catching design and simple, easy to use functionality. It’s important that while retailers are implementing new technologies and merchandising innovations they don’t lose sight of the overall goal of an ecommerce website; to convert customers.</p>
<p>In addition, the advancement of mobile browsing and m-commerce has put an even greater emphasis on usability. Smaller display areas and touch screen technology is forcing retailers to think more about how to enable consumers to purchase in the least amount of clicks possible. Mobile websites will be covered in another post at a later date but for now the focus is on fashion vs. usability.</p>
<h2><strong>Eye-Catching Design</strong></h2>
<p><strong>Whistles</strong></p>
<p><strong><br />
</strong></p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/08/Whistles_Dresses.gif" rel="lightbox[2073]"><img class="aligncenter size-medium wp-image-2075" src="http://www.wmps.com/blog/wp-content/uploads/2010/08/Whistles_Dresses-300x158.gif" alt="" width="401" height="210" /></a></p>
<p>This very unique new website from Whistles was launched earlier this year, and sparked controversy among critics. Yes it is different, yes it is innovative and eye catching, but have the designers got a bit too carried away? The style of the site means that users are engaged right though the browsing process, with model imagery used from the homepage, through the category listings right to product details. They also integrate well with social media, offering links to share via email, facebook and twitter. The imagery on the site is good, and there are plenty of alternate images and zoom utilised on everything.</p>
<p>However, it’s the small things that Whistles have forgotten, such as a search box, or refine feature, making it very difficult to find something specific, or within a certain budget for example. Also, there are no sub-categories in the top navigation bar; rather they are displayed on the main page, mixed in with the model imagery. This makes it very easy to get lost in the middle of the screen and not be able to find the category that you want.</p>
<h2><strong>Fashionable but Usable</strong></h2>
<p><strong>River Island</strong></p>
<p>I thought it was fitting to use River Island as my example in this category as this site used to be another culprit of ‘Flash overkill’. However River Island has recently revamped their site to make it more usable. And in my opinion they’ve done a pretty good job! They’ve managed to retain some individuality by allowing refinements according to swatches of colour, pattern descriptions and even ‘occasion’. They’ve also spruced up their product listings by inserting a top product into a larger box at the top left of each page, similar to a profile picture layout. Not only does this act as a merchandising tool but serves to differentiate River Island product listings from those on their competitor’s websites.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/08/RiverIsland-product-listing.gif" rel="lightbox[2073]"><img class="aligncenter size-medium wp-image-2076" src="http://www.wmps.com/blog/wp-content/uploads/2010/08/RiverIsland-product-listing-295x300.gif" alt="" width="345" height="351" /></a></p>
<p>They’ve also added a quick look or closer look feature, which allows you to either view the product in a pop up box while still on the category listing page, or to go right into the product details page for a closer look. Although this is a nice feature, there isn’t much difference between the information given in the two options, aside from a few ‘get the look’ items on the product details page. By adding more in depth product information to the details page River Island could have added value to the feature and given consumers a more compelling reason to visit the product details page if they were interested in the product, thus increasing the chance of up and cross-selling more items.</p>
<h2><strong>Finding a Compromise</strong></h2>
<p>For many companies, both new to ecommerce and old hats that are looking to revamp their offering, it is important that the basics of usability and good customer experience don’t get lost in a web of flash and unnecessary gadgets. There are some new technologies that will genuinely enhance your customers experience online, but there are some that will detract from it. In all elements of ecommerce, especially web design, usability should be a key consideration, because if your customers can’t use it they won’t buy from it.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/usability/fashion-vs-usability/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Hypothesis Testing in A/B Testing</title>
		<link>http://www.wmps.com/blog/website-analysis/web-analytics/hypothesis-testing-in-ab-testing/</link>
		<comments>http://www.wmps.com/blog/website-analysis/web-analytics/hypothesis-testing-in-ab-testing/#comments</comments>
		<pubDate>Tue, 10 Aug 2010 08:00:51 +0000</pubDate>
		<dc:creator>Wei Shao</dc:creator>
				<category><![CDATA[Web Analytics]]></category>
		<category><![CDATA[A B Testing]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=1939</guid>
		<description><![CDATA[In my last post, I went through hypothesis testing with a simple coin flipping example. Now we have established that Hypothesis testing is a way of systematically quantifying how certain you are of the result of a statistical experiment. It starts by forming a null hypothesis such as “Design A performs better”, and then converts [...]]]></description>
			<content:encoded><![CDATA[<p>In my last post, I went through hypothesis testing with a simple coin flipping example.</p>
<p>Now we have established that Hypothesis testing is a way of systematically quantifying how certain you are of the result of a statistical experiment. It starts by forming a null hypothesis such as “Design A performs better”, and then converts it to a mathematical statement. Finally, we need to put in a probability distribution to test it using a specific confidence level. In today’s article, we will apply this to our real world analytics application: A/B Testing.</p>
<h2>What is A/B Testing?</h2>
<p>A/B testing is one of primary tools in any data-driven environment.  It&#8217;s a way of conducting experiments where you compare a baseline control sample to one or more test samples by assigning each sample a specific single variable change.</p>
<p>For example, you might have a landing page that shows the latest products list. You&#8217;ll want to test various layouts to try and maximize the sales made by this page. Normally, we use “conversion rate” to measure the page&#8217;s performance. By assigning the control sample and each test sampling similar traffic, we can make a decision by observing the conversion rate.</p>
<h2>The Fake Data</h2>
<p>You might ask: “Why do we need hypothesis testing if we already have conversion rate to measure the performance?”</p>
<p>Assume you are running an email campaign to show the latest offers. You have 3 versions with different layouts: control sample, test sample A, and test sample B.  You run an A/B test before formally running the campaign. Here are the results you might get:</p>
<table border="0" cellspacing="0" cellpadding="0" width="430">
<tbody>
<tr>
<td width="111" valign="bottom"><strong>Version</strong></td>
<td width="111" valign="bottom"><strong>visitors treated</strong></td>
<td width="91" valign="bottom"><strong>Orders</strong></td>
<td width="118" valign="bottom"><strong>Conversion Rate</strong></td>
</tr>
<tr>
<td width="111" valign="bottom">Control Sample</td>
<td width="111" valign="bottom">182</td>
<td width="91" valign="bottom">35</td>
<td width="118" valign="bottom">19.23%</td>
</tr>
<tr>
<td width="111" valign="bottom">Test Sample A</td>
<td width="111" valign="bottom">180</td>
<td width="91" valign="bottom">45</td>
<td width="118" valign="bottom">25%</td>
</tr>
<tr>
<td width="111" valign="bottom">Test Sample B</td>
<td width="111" valign="bottom">189</td>
<td width="91" valign="bottom">28</td>
<td width="118" valign="bottom">14.81%</td>
</tr>
</tbody>
</table>
<p>In terms of the results, could we make a judgement that A is best now? When the sample size is large, the results might turn into this:</p>
<table border="0" cellspacing="0" cellpadding="0" width="428">
<tbody>
<tr>
<td width="111" valign="bottom"><strong>Version</strong></td>
<td width="111" valign="bottom"><strong>visitor treated</strong></td>
<td width="87" valign="bottom"><strong>Orders</strong></td>
<td width="119" valign="bottom"><strong>Conversion Rate</strong></td>
</tr>
<tr>
<td width="111" valign="bottom">Control Sample</td>
<td width="111" valign="bottom">10000</td>
<td width="87" valign="bottom">2550</td>
<td width="119" valign="bottom">25.50%</td>
</tr>
<tr>
<td width="111" valign="bottom">Test Sample A</td>
<td width="111" valign="bottom">10000</td>
<td width="87" valign="bottom">2000</td>
<td width="119" valign="bottom">20%</td>
</tr>
<tr>
<td width="111" valign="bottom">Test Sample B</td>
<td width="111" valign="bottom">10000</td>
<td width="87" valign="bottom">1800</td>
<td width="119" valign="bottom">18.00%</td>
</tr>
</tbody>
</table>
<p>Don’t be surprised if you get these results, because the sample size matters. The problem is when you run an email campaign you wouldn’t be able to get a large test sample size. If you make a judgement only based on the comparison of the conversion rate, you might just make a wrong decision.</p>
<h2>Hypothesis Testing</h2>
<p>In order to avoid the wrong decision, you might need to use hypothesis testing to justify the results you get, especially for the small sample size or similar results.</p>
<p>Remember the statistics principle we mentioned in the last post: if a small probability event happens in your test sample, you could reject the null hypothesis. In this case, the null hypothesis could be that the conversion rate of the control treatment is no less than the conversion rate of our experimental treatment. So mathematically</p>
<p><em>H</em><sub>0</sub> = <em>P</em> &#8211; <em>P</em><sub>c</sub> ≤ 0</p>
<p>Where <em>P</em><sub>c</sub> is the conversion rate of the control and <em>P</em> is the conversion rate of one of our experiments.</p>
<p>Therefore if the probability of <em>H</em><sub>0</sub> is low enough, we could reject it and go for the alternative hypothesis, that is “the experimental email campaign has a higher conversion rate”. That is what we want to see and quantify.</p>
<p>In order to measure the probability of <em>H</em><sub>0</sub>, let’s say P(<em>H</em><sub>0</sub>), we need to know its probability distribution. The sampled conversion rates are all normally distributed random variables just like the coin flipping. Instead of seeing whether it deviates too far from a fixed probability we want to measure whether it deviates too far from the control treatment. There is another statistic rule: the sum or difference of two normally distributed variables is itself normally distributed. With this rule, we could do Z-Test and calculate the 95% confidence interval like we did in the coin flipping example.</p>
<h2>Z-Test</h2>
<p>Mathematically, the calculation of Z-Score for the probability of <em>H</em><sub>0</sub> is:</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/08/equation1.jpg" rel="lightbox[1939]"><img class="aligncenter size-full wp-image-1940" title="equation1" src="http://www.wmps.com/blog/wp-content/uploads/2010/08/equation1.jpg" alt="" width="221" height="66" /></a></p>
<p>Where N is the size of the experiment sample and <em>N</em><sub>c</sub> is the size of the control sample.</p>
<p>Do you remember that we used the z-score of 1.96 to correspond to the 95% confidence interval? This time it&#8217;s a little different. We will use 1.65 instead of 1.96. Why? In the coin flip example, the null hypothesis is P = 0.5. Therefore we could reject it if the probability is too high or too low, but this time we only care one way.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/08/two-tailed.jpg" rel="lightbox[1939]"><img class="aligncenter size-medium wp-image-1942" title="two-tailed" src="http://www.wmps.com/blog/wp-content/uploads/2010/08/two-tailed-300x219.jpg" alt="" width="300" height="219" /></a></p>
<p>If the z-score falls in the blue part, we assume it is a small probability and reject the null hypothesis. In the coin flip example, the blue part distributes on both sides of the normal distribution. It is called a two tailed test.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/08/one-tailed.jpg" rel="lightbox[1939]"><img class="aligncenter size-medium wp-image-1941" title="one-tailed" src="http://www.wmps.com/blog/wp-content/uploads/2010/08/one-tailed-300x219.jpg" alt="" width="300" height="219" /></a>In this A/B Testing example, we&#8217;ll only reject the null hypothesis if the experimental conversion rate is significantly higher than the control conversion rate. The blue part is only on the right trail of the normal distribution. This is called a one tailed test.</p>
<p>Using the formula above, we could get the following results:</p>
<table border="0" cellspacing="0" cellpadding="0" width="478">
<tbody>
<tr>
<td width="107" valign="bottom"><strong>Version</strong></td>
<td width="113" valign="bottom"><strong>visitors treated</strong></td>
<td width="67" valign="bottom"><strong>Orders</strong></td>
<td width="123" valign="bottom"><strong>Conversion Rate</strong></td>
<td width="68" valign="bottom"><strong>Z-Score</strong></td>
</tr>
<tr>
<td width="107" valign="bottom">Control Sample</td>
<td width="113" valign="bottom">182</td>
<td width="67" valign="bottom">35</td>
<td width="123" valign="bottom">19.23%</td>
<td width="68" valign="bottom">N/A</td>
</tr>
<tr>
<td width="107" valign="bottom">Test Sample A</td>
<td width="113" valign="bottom">180</td>
<td width="67" valign="bottom">45</td>
<td width="123" valign="bottom">25%</td>
<td width="68" valign="bottom">1.33</td>
</tr>
<tr>
<td width="107" valign="bottom">Test Sample B</td>
<td width="113" valign="bottom">189</td>
<td width="67" valign="bottom">28</td>
<td width="123" valign="bottom">14.81%</td>
<td width="68" valign="bottom">-1.13</td>
</tr>
</tbody>
</table>
<p>We could find that none of the z-scores is large than 1.65, which means the results would likely change if the sample size goes larger. In this case, we can’t decide which one is best, and we&#8217;d need a larger sample size to get a right decision.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/web-analytics/hypothesis-testing-in-ab-testing/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Statistics and Web Analytics &#8211; Hypothesis Testing</title>
		<link>http://www.wmps.com/blog/website-analysis/web-analytics/statistics-and-web-analytics-hypothesis-testing/</link>
		<comments>http://www.wmps.com/blog/website-analysis/web-analytics/statistics-and-web-analytics-hypothesis-testing/#comments</comments>
		<pubDate>Fri, 30 Jul 2010 16:19:08 +0000</pubDate>
		<dc:creator>Wei Shao</dc:creator>
				<category><![CDATA[Web Analytics]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=1832</guid>
		<description><![CDATA[Most people using web analytics don’t need the complicated mathematics a company like NASA does, but you might still be asked to use some common statistics methods. In my earlier post, I discussed predictive analysis in web analytics. Today, I will introduce a statistics tool – hypothesis testing, which is commonly used in A/B Testing. [...]]]></description>
			<content:encoded><![CDATA[<p>Most people using web analytics don’t need the complicated mathematics a company like NASA does, but you might still be asked to use some common statistics methods. In my earlier post, I discussed predictive analysis in web analytics. Today, I will introduce a statistics tool – hypothesis testing, which is commonly used in A/B Testing.</p>
<h3>Hypothesis Testing</h3>
<p>Hypothesis testing is something that you can use to make decisions based on experimental data. It can systematically quantify how certain you are of the result of a statistical experiment.  For example, you might want to test if coin flipping would give a fair result. So you make an experiment where you flip the coin 100 times and you get results of 52 times for head side and 48 times for tails side. Would that be fair enough from the statistical view? That’s why you want to do a hypothesis testing.</p>
<p>Most hypothesis testing uses null-hypothesis. The null-hypothesis, denoted <em>H</em><sub>0</sub>, typically proposes a default position, such as the coin flipping is fair. And it is typically paired with an alternative hypothesis, such as the coin is biased, denoted <em>H</em><sub>1</sub>. Normally, we put the hypothesis we care or we want to be true as the null-hypothesis. And the main goal of hypothesis testing is to tell us whether we have enough evidence to reject the null-hypothesis.</p>
<h3>Turning to statistics</h3>
<p>After stating the relevant null and alternative hypotheses, we&#8217;ll need to think in a statistical way. In the above coin example, if we say the coin is fair, that means the probability of getting a head side should be 50%. But the results of the experiment we got were 52%.  But is this normal because we just flipped it 100 times as the experiment?</p>
<p>Statistically, if the probability of something is very low, we consider it as impossible. In this case if probability of having the variance between the experiment results and hypothesis is small enough, we could reject the hypothesis. That&#8217;s because if something is considered to be impossible and it happens in the small set of observations, there must be something wrong with the hypothesis.</p>
<h3>Mathematically</h3>
<p>Now we have to do it completely mathematically.  The null hypothesis in the coin example could be expressed as</p>
<p><em>H</em><sub>0</sub>:<em>p</em><sub>0</sub> = 0.5</p>
<p>A 95% confidence level means we reject the null hypothesis if p falls outside 95% the area of the normal curve given above. We can see this corresponds to approximately 1.98 standard deviations.</p>
<p>Then we use “Z-Test” to get the z-score which tells us how many standard deviations away from the mean our sample is, and it’s calculated as</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/07/equation.jpg" rel="lightbox[1832]"><img class="aligncenter size-full wp-image-1835" title="equation" src="http://www.wmps.com/blog/wp-content/uploads/2010/07/equation.jpg" alt="" width="148" height="65" /></a></p>
<p>The p is the sample mean, and the <em>P</em><sub>0</sub> is the expected mean, and N is the sample size.  For the coin example, <em>P</em><sub>0</sub> is 0.5 and N = 100.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/07/normal-curve-small.png" rel="lightbox[1832]"><img class="aligncenter size-medium wp-image-1834" title="normal-curve-small" src="http://www.wmps.com/blog/wp-content/uploads/2010/07/normal-curve-small-300x225.png" alt="normal curve small" width="300" height="225" /></a></p>
<p>In our experiment we flipped the coin 100 times and got heads 52 times, so the sample mean is 0.52%. After calculating the z-score by the formula above, we get the z-score as 0.4 and make the conclusion that the coin is fair.  If we use coin 2 and get heads 60 times, we can reject the hypothesis and say that coin 2 is biased.</p>
<h3>What’s next</h3>
<p>Of course, this could be much more complex than coin flipping in real world applications. Fortunately, hypothesis testing for the A/B testing is usually quite similar to coin flipping. In my next post, I will show you how to apply our hypothesis testing knowledge to A/B testing to determine whether new features actually affect user behaviour.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/web-analytics/statistics-and-web-analytics-hypothesis-testing/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Predictive Analytics: Do They Work?</title>
		<link>http://www.wmps.com/blog/website-analysis/web-analytics/predictive-analytics-do-they-work/</link>
		<comments>http://www.wmps.com/blog/website-analysis/web-analytics/predictive-analytics-do-they-work/#comments</comments>
		<pubDate>Mon, 05 Jul 2010 13:27:44 +0000</pubDate>
		<dc:creator>Wei Shao</dc:creator>
				<category><![CDATA[Web Analytics]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=1554</guid>
		<description><![CDATA[Data mining and predictive analytics have been used to complete many tough tasks, such as cross-selling, direct marketing and fraud detection, in different types of businesses. In fact, where there is any type of data warehousing there should be implementation of a business intelligence program that includes predictive analytics to some degree. However, predictive analytics [...]]]></description>
			<content:encoded><![CDATA[<p>Data mining and predictive analytics have been used to complete many tough tasks, such as cross-selling, direct marketing and fraud detection, in different types of businesses. In fact, where there is any type of data warehousing there should be implementation of a business intelligence program that includes predictive analytics to some degree. However, predictive analytics are still not commonly employed in web analytics. With this article, I’m going to explore the possibilities of predictive analytics in web analytics.</p>
<h3>About Predictive Analytics</h3>
<p>Basically, the main idea of predictive analysis is to use past data to predict future events. The statistics models is used to capture relationships among many factors to allow assessment of risk, determine market patterns, or predict potential opportunities for growth.</p>
<h3>Why Is It Difficult to Include in Web Analytics?</h3>
<p>One of the most important factors responsible for reliable predictive analysis is data quality. Because all predictive events are based on the data we have, the information can only be as effective as the abundance and accuracy of data available. Due to the mechanism of data collection, unfortunately, web data for the most part is completely anonymous, usually incomplete and unstructured.  For example, cookies and JavaScript could be blocked by some proportion of users or it could be loaded and activated improperly due to slow network speed or other technical reasons.  And it is important to know that these are quite normal for data collection in web analytics today. So it is really hard to do predictive analysis when the core things you are relying to capture data are anonymous cookies and sensitive JavaScript tags.</p>
<h3>Available Predictive Web Analytics</h3>
<p>Many web analytics solutions providers have started to research to offer predictive analytics solutions along with web analytics. One example is The Intelligent Offer, which is provided by Coremetrics and generates personalized cross-sell and up-sell recommendations based on web data. It uses cookies to build individual visitor profiles based on historical and current session data. The profile is then fed into the personalisation algorithm, which determines if and how recommendations are tailored to the individual.</p>
<p style="text-align: center;"><a href="http://www.wmps.com/blog/wp-content/uploads/2010/07/Blog-3.jpg" rel="lightbox[1554]"><img class="size-medium wp-image-1556 aligncenter" title="Blog (3)" src="http://www.wmps.com/blog/wp-content/uploads/2010/07/Blog-3-300x230.jpg" alt="Halfords" width="300" height="230" /></a></p>
<p>Traffic prediction also is a feasible possibility for implementing predictive analysis in web analytics. Because visitor traffic is time series data and relatively cleaner than the other metrics we get from the web analytics tool, many statistical models could be used to analyze it and forecast future traffic based on past data.  Here is a mobile traffic prediction example we did for a client. We employed a polynomial regression model to forecast future mobile traffic.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/07/Blog-2.jpg" rel="lightbox[1554]"><img class="aligncenter size-medium wp-image-1555" title="Blog 2" src="http://www.wmps.com/blog/wp-content/uploads/2010/07/Blog-2-300x160.jpg" alt="mobile visits increasing" width="300" height="160" /></a></p>
<h3>Web analytics Needed for Multichannel CRM</h3>
<p>Many companies now have realized that basic click stream analytics don’t tell the whole story. They are looking for a more intelligent way to find hidden customer behaviors. In order to implement predictive data analysis for web data, they need to expand their web analytics strategies and integrate web analytics with CMS (customer relationship management) systems.</p>
<p>With multichannel CRM, aggregated web data could be integrated into offline channels and provide great insight, even from simple analysis. It would enable online analytical processing (OLAP) to produce historical perspectives on customer acquisition cost, cost per conversion, etc. And combining web analytics with predictive analytics, such as data mining, could provide both historical and predictive insights.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/web-analytics/predictive-analytics-do-they-work/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Improving Form Completion Rates with Google Analytics</title>
		<link>http://www.wmps.com/blog/website-analysis/conversion-optimisation/improving-form-completion-rates-with-google-analytics/</link>
		<comments>http://www.wmps.com/blog/website-analysis/conversion-optimisation/improving-form-completion-rates-with-google-analytics/#comments</comments>
		<pubDate>Fri, 02 Jul 2010 08:00:08 +0000</pubDate>
		<dc:creator>Matthew Redford</dc:creator>
				<category><![CDATA[Conversion Optimisation]]></category>
		<category><![CDATA[conversion rates]]></category>
		<category><![CDATA[event tracking]]></category>
		<category><![CDATA[google analytics]]></category>
		<category><![CDATA[javascript]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=1539</guid>
		<description><![CDATA[Website forms are a constant barrier to conversions on your site whether it is a sale, sign up or information request.  A form consists of multiple areas which directly affect your conversion rates.  Here are a couple of questions you could ask yourself: The length of the form – is it too long? Is there [...]]]></description>
			<content:encoded><![CDATA[<p>Website forms are a constant barrier to conversions on your site whether it is a sale, sign up or information request.  A form consists of multiple areas which directly affect your conversion rates.  Here are a couple of questions you could ask yourself:</p>
<ul>
<li>The length of the form – is it too long?</li>
<li>Is there help available for completing all of the form elements?</li>
<li>Are validation messages clear and easy to understand?</li>
</ul>
<p>Tracking a custom form is not a standard feature of most Analytics packages. This is how we would recommend doing it through Google Analytics.</p>
<ol>
<li>Make sure your site has Google Analytics installed for all pages and it is tracking correctly.</li>
<li>Setup an over-arching goal within Google Analytics for the conversion page you want to track, the thank you page of a successful sale for example.</li>
<li>Specific events on your website can be tracked via ‘Event Tracking’ which is an advanced feature of Google Analytics.  Most forms within websites use JavaScript validation as a 1st port of call. We will integrate ‘Event Tracking’ within the existing JavaScript validation to track form events.</li>
</ol>
<p>The ‘Event Tracking’ tag looks like this: <em><strong>_trackEvent(category, action, opt_label, opt_value)</strong></em>. Let’s say for example that your form validates whether the 1st element of your form (first name for example) is required. If a user leaves this element empty and submits the form it will trigger the relevant piece of validation for this. The site may show an alert box which tells the user that this element has been left blank and is required.</p>
<p>Now let’s add an ‘Event Tracking’ tag within the piece of JavaScript code which has just been triggered, such as <em><strong>_trackEvent(My Website Form, Validation Error, First Name Blank)</strong></em>. Now leave the 1st element of your form intentionally blank and submit the form. The same validation message will appear but this time the event will have been recorded within the Google Analytics profile for your website.</p>
<p>It gives us key information on how a website form is performing. What causes the most errors? How could I improve this? It allows us to actively make changes to a form and test whether it has improved the overall conversion rate. If monitored regularly &amp; improvements are made it should lead to an optimally performing form!</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/conversion-optimisation/improving-form-completion-rates-with-google-analytics/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>UK Companies have a long way to go in Engaging Visitors Online</title>
		<link>http://www.wmps.com/blog/website-analysis/uk-companies-have-a-long-way-to-go-in-engaging-visitors-online/</link>
		<comments>http://www.wmps.com/blog/website-analysis/uk-companies-have-a-long-way-to-go-in-engaging-visitors-online/#comments</comments>
		<pubDate>Thu, 01 Jul 2010 08:30:01 +0000</pubDate>
		<dc:creator>Emma Gray</dc:creator>
				<category><![CDATA[Website Analysis]]></category>
		<category><![CDATA[Online Engagement]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=1509</guid>
		<description><![CDATA[The Engaged Web, a benchmark study published by EpiServer, has revealed that many online brands have not yet taken advantage of increasing levels of visitor engagement on their website. The Engaged Web report analysed eighty companies ranked by Hitwise as being the most visited in the UK, spanning eight vertical sectors – Telecoms, Charity, Retail, [...]]]></description>
			<content:encoded><![CDATA[<p>The Engaged Web, a benchmark study published by EpiServer, has revealed that many online brands have not yet taken advantage of increasing levels of visitor engagement on their website. The Engaged Web report analysed eighty companies ranked by Hitwise as being the most visited in the UK, spanning eight vertical sectors – Telecoms, Charity, Retail, Sport, Travel, Public Sector, Finance and Utilities &#8211; and scored them against a matrix of criteria for an in-depth assessment of their online engagement and interactivity strategies.   The criteria assessed a range of different components that make up an engaged website including Blogging, Communities, Multimedia Content and Social Media to name a few. The key findings have been identified below.</p>
<p>The scores and key areas of neglect clearly varied between the vertical sectors. For instance every one of the ten Sports sites featured a blog and community, Travel sites were also not far behind with 60% of sites maintaining a blog in an attempt to engage with their audience. In other sectors the results were not quite as impressive with the Finance and Telecoms sectors failing to provide sufficient sticky content to hold visitor attention and encourage them to return.</p>
<h3><strong>Key Findings Include: </strong></h3>
<h4>Blogging</h4>
<p>Blogs are not getting the attention they require yet they tend to be easy to use, implement, update and offer businesses the opportunity to speak directly to visitors in a personable way.  Just less than half of the sites (40%) featured a blog, however too many were not frequently updated, defeating the key objective of a blog as readers quickly lose interest. Only 34% of the blogs were updated on a regular basis, while only 19% of the brands assessed were identified to be advertising the blog across the rest of the website. The results also differed between the eight sectors as every Sports website reviewed featured a blog along with the majority of Travel and Community websites.</p>
<p>The report identifies that the uSwitch blog is an example of how it should be done, although the blog is not promoted prominently enough across the rest of the site. It is also felt that by pulling in the RSS feed on the homepage the blog reference could be made more prominent.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/06/uswitchblog.jpg" rel="lightbox[1509]"><img class="aligncenter size-medium wp-image-1511" src="http://www.wmps.com/blog/wp-content/uploads/2010/06/uswitchblog-300x186.jpg" alt="uswitchblog" width="300" height="186" /></a></p>
<h3>Communities (Forums, Community Blogs &amp; Message Boards)</h3>
<p>Communities allow visitors to generate content on the site but they do require ongoing management to really make visitors feel valued and are continually encouraged to contribute constructively. Only a third (34%) of the companies studied featured a community on their site, with Telecoms brands coming out on top, closely followed by charities. In terms of usage only 44% of companies with a community actually attempted to initiate a conversation with visitors, although more do tend to respond to queries or questions from users, with 70% actively engaging with users. However not a single company studied was identified to be regularly uploading content to their community.</p>
<p><strong> </strong></p>
<p>The report highlights RSPB community as a best practise example, with plenty of features and content to keep users interested and keep returning on a regular basis<strong>. </strong></p>
<h3><strong><a href="http://www.wmps.com/blog/wp-content/uploads/2010/06/RSPB-Community.jpg" rel="lightbox[1509]"><img class="aligncenter size-medium wp-image-1512" src="http://www.wmps.com/blog/wp-content/uploads/2010/06/RSPB-Community-300x53.jpg" alt="RSPB Community" width="300" height="53" /></a></strong><strong> </strong></h3>
<h3><strong>Multimedia Content &amp; Rich Media (Images, Videos, Podcasts, Presentations) </strong></h3>
<p>Multimedia Content is one of the best ways to quickly and instantly grab visitor attention and encourage them to further explore the website. Only 28% of the companies assessed have some sort of multimedia content on their websites. Sports sites came out on top again, yet other brands have a long way to go in this section.  Copy was also assessed to determine how engaging it is to viewers. On average companies assessed were scored around 4.8 out of 7, thus suggesting there is more to be done to capture the attention of web visitors.</p>
<p>Paddy Power is identified as a stand out website in this category, offering a number of videos and live sports streaming is provided for registered members. The use of video is also closely related to the purpose of the Paddy Power site, thus encouraging visitors to remain on the site for longer.</p>
<h3><a href="http://www.wmps.com/blog/wp-content/uploads/2010/06/paddypower.jpg" rel="lightbox[1509]"><img class="aligncenter size-medium wp-image-1513" src="http://www.wmps.com/blog/wp-content/uploads/2010/06/paddypower-300x219.jpg" alt="paddypower" width="300" height="219" /></a><strong> </strong></h3>
<h3><strong>Social Media </strong></h3>
<p>The Econsultancy indicate that other studies have found that brands fail to sufficiently advertise their Social Media accounts on their websites and this study is no different. The scores were significantly low with brands failing to encourage online interaction with their visitors and customers or integrate and optimise their online presence. Only 15% of companies were identified as advertising their Twitter account directly on the homepage and only 19% draw attention to their Facebook fan page. In addition 34% of the sites provide links that allow a visitor to share content on a social network, but only 16% allow the visitor to rate and tag content.</p>
<p>The report identifies ASOS as a strong example of a brand with an integrated social media strategy.  It clearly promotes its social media presence on the website and has accounts on the four biggest Social Media channels.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/06/ASOS.jpg" rel="lightbox[1509]"></a><a href="http://www.wmps.com/blog/wp-content/uploads/2010/06/ASOS.jpg" rel="lightbox[1509]"></a><a href="http://www.wmps.com/blog/wp-content/uploads/2010/06/ASOS2.jpg" rel="lightbox[1509]"><img class="aligncenter size-medium wp-image-1525" src="http://www.wmps.com/blog/wp-content/uploads/2010/06/ASOS2-300x199.jpg" alt="ASOS2" width="300" height="199" /></a><br />
Whilst many companies have taken a number of steps to make their website more engaging for visitors, the study indentifies that there is still more to be done. As the web is continuing to grow in importance, delivering engaging online experiences will become critical for businesses looking to encourage brand loyalty and improve their business online. Online engagement can ultimately bring a number of benefits including increased brand affinity, loyalty along with bottom line results.</p>
<p>EPiServer also suggest that companies can become more efficient by using an online platform to publish information quickly, introduce multimedia content and build and host online communities. Our Redfish ecommerce application has been designed with improving customer engagement in mind, offering the opportunity to refresh the online shopping experience and provide more inspiring imagery.  Don’t hesitate to contact us to find out more.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/uk-companies-have-a-long-way-to-go-in-engaging-visitors-online/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Facebook Fan Page Marketing part 2: Facebook Analytics</title>
		<link>http://www.wmps.com/blog/website-analysis/web-analytics/facebook-fan-page-marketing-part-2-facebook-analytics/</link>
		<comments>http://www.wmps.com/blog/website-analysis/web-analytics/facebook-fan-page-marketing-part-2-facebook-analytics/#comments</comments>
		<pubDate>Thu, 17 Jun 2010 13:35:59 +0000</pubDate>
		<dc:creator>Wei Shao</dc:creator>
				<category><![CDATA[Web Analytics]]></category>
		<category><![CDATA[analytics]]></category>
		<category><![CDATA[Facebook]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=1431</guid>
		<description><![CDATA[In my earlier post, I described the Facebook fan page and how it can benefit a business’ online marketing. Today, I’ll discuss how to measure the effect of the Facebook ecosystem on your marketing with Facebook analytics. Why Do Businesses Need to Measure Facebook Analytics? Since Facebook is a good place for marketing, there must [...]]]></description>
			<content:encoded><![CDATA[<p>In my earlier post, I described the <a href="http://www.wmps.com/blog/online-marketing/social-media/facebook-fan-page-marketing-part-1/">Facebook fan page</a> and how it can benefit a business’ online marketing. Today, I’ll discuss how to measure the effect of the Facebook ecosystem on your marketing with Facebook analytics.</p>
<h3><strong>Why Do Businesses Need to Measure Facebook Analytics?</strong></h3>
<p>Since Facebook is a good place for marketing, there must be some demand for analytics.</p>
<ul>
<li>Observing visitors’ interactions with your fan page will give you basic insights into the performance of your business’ Facebook fan page and other apps.</li>
<li>Facebook analytics can provide much more valuable information than normal analytics, such as demographics, gender, and education level. It is important to know who your potential customers are before you run a campaign.</li>
</ul>
<h3><strong>Why Is Measuring So Difficult?</strong></h3>
<p>As I mentioned before, Facebook requires that organizations use their own markup language, Facebook Markup Language (FBML), to build a custom fan page instead of standard HTML. Furthermore, Facebook doesn’t allow standard JavaScript to run on a page on load. This means that when a visitor opens a Facebook fan page, JavaScript can’t be activated if the visitor doesn’t do anything. Instead, the developers have to use Facebook’s own solution FBJS (Facebook JavaScript) if they want to include any JavaScript in their custom fan page. Whether Facebook wants to protect users’ privacy or to build their own empire, this requirement makes tracking using traditional web analytics JavaScript tags impossible.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/06/weiblog2.jpg" rel="lightbox[1431]"><img class="aligncenter size-medium wp-image-1432" title="weiblog2" src="http://www.wmps.com/blog/wp-content/uploads/2010/06/weiblog2-300x227.jpg" alt="" width="300" height="227" /></a></p>
<h3><strong>Available Facebook Analytics Tools</strong></h3>
<p>The main analytics vendors have already announced their capabilities to measure social networking. The Facebook analytics war began when WebTrends first announced their Facebook analytics capability. A few days later, Omniture and Coremetrics unveiled their own. Meanwhile, Facebook provide their own free analytics service, Facebook Insights.</p>
<ul>
<li>WebTrends was the first company that announced their Facebook analytics capability from the three main vendors.  They use an innovative method which uses a data call to pass parameters from the data collection API to capture all of the typical data as well as tracking flash, pop ups, email signups and other custom fields.</li>
<li>The partnership between Adobe-owned Omniture and Facebook has enabled marketers to buy the capability to measure Facebook media through Omniture’s search campaign management platform. Ominiture has also developed a FBJS measurement library that allows them to track behavior data natively within Facebook.</li>
<li>Social network analytics as well as mobile analytics are highlighted as one of the key new features by Coremetrics whenever they promote their new product ‘Analytics 2010’. This allows users to see how interaction with specific tabs leads to web site engagement and conversion. However, Coremetrics hasn’t dedicated any focus to reporting user interactions within Facebook.</li>
<li>Facebook Insights is a free analytics tool provided by Facebook. It offers an aggregate view of fans’ interactions and demographic information across the custom fan pages and apps. Earlier this month, Facebook announced a new enhanced version which will show data for both fully-integrated sites and sites that use Facebook’s social plug-ins. In other words, now you can view the specific story that people ‘liked’ on your site or how many people commented on posts on your Facebook fan page.</li>
</ul>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/06/weiblog3.jpg" rel="lightbox[1431]"><img class="aligncenter size-medium wp-image-1433" title="weiblog3" src="http://www.wmps.com/blog/wp-content/uploads/2010/06/weiblog3-300x274.jpg" alt="" width="300" height="274" /></a></p>
<h3>Can I Just Use Google Analytics?</h3>
<p>Finally, it is time to turn to our favourite analytics program – Google Analytics. Google hasn’t officially announced their capability to measure Facebook analytics. However, many intelligent GA fans are working on it and trying to figure out how to enable Google Analytics on Facebook. There is an open source tool called FBGAT (Facebook Google Analytics Tracker) hosted by Webdigi which allows users to generate a Google Analytics tracking code for Facebook fan pages and paste it into Facebook custom tabs. The online version of the tracking code generator can be found <a href="http://ga.webdigi.co.uk/">here</a>. After pasting the code on the FBML page, your results will appear in the Google Analytics content report in the next 24 hours. You can find more information about the Google Analytics for Facebook project at Facebook’s Developer Wiki Page.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/web-analytics/facebook-fan-page-marketing-part-2-facebook-analytics/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Metrics vs KPIs: All you need to know!</title>
		<link>http://www.wmps.com/blog/website-analysis/web-analytics/goals-vs-kpis-analytics-tips/</link>
		<comments>http://www.wmps.com/blog/website-analysis/web-analytics/goals-vs-kpis-analytics-tips/#comments</comments>
		<pubDate>Wed, 05 May 2010 08:00:12 +0000</pubDate>
		<dc:creator>Wei Shao</dc:creator>
				<category><![CDATA[Web Analytics]]></category>
		<category><![CDATA[Analytics Goals]]></category>
		<category><![CDATA[Key perfomance indicators]]></category>
		<category><![CDATA[KPI]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=1048</guid>
		<description><![CDATA[Recently, I have been researching how to collect and measure useful  key performance indicators from the  metrics available in Google analytics tools. As part of this investigation I am going to introduce a Web analytics measurement framework to define the KPIs for travel sites. The travel industry today is facing severe challenges like price wars, [...]]]></description>
			<content:encoded><![CDATA[<p>Recently, I have been researching how to collect and measure useful  key performance indicators from the  metrics available in Google analytics tools. As part of this investigation I am going to introduce a Web analytics measurement framework to define the KPIs for travel sites.</p>
<p>The travel industry today is facing severe challenges like price wars, safety and security issues (and that&#8217;s not even going into the volcano problems of late). Now the internet is providing a medium that  increases customer awareness of these issues. Essentially being a tour operator online is as difficult as ever. Only adding to the difficulty is the issue of measuring a tour operators website performance, which can be hard at the best of times in comparison to a retail site due to the company selling invisible products like ‘experience’. Website traffic and conversions can easily be tracked, measured and compared but how do you define a conversion for example on website where you can&#8217;t directly book? This is a problem a lot of luxury tour operators face. A way out is to find out the Key Performance Indicator (KPI) to measure performance.</p>
<p><strong> </strong></p>
<h2><strong>What is the difference between a metric and a KPI?</strong></h2>
<p>Before I start to go through the travel site examples, it probably makes the most sense to talk about the difference between metrics and KPIs. A metric just is a number, it can be viewed as a count (number of visitors) or a ratio (conversion rate). All of the data we get from analytics tools are metrics.</p>
<p>KPIs are metrics, but not normal metrics. A definition of a KPI is a metric that helps you understand how you are doing against your objectives. In other words, KPIs are a bridge between business objectives and web analytics data. Because different companies have different objectives, the KPIs tend to be unique to each company.</p>
<p>For example, on an ecommerce site like www.24studio.co.uk, the objective is to sell as much product as possible. So the KPI could be based on the number of orders, and average size of orders. For the a luxury travel site www.turquoiseholidays.co.uk, the business objective can be sending out so many brochures to encourage a holiday purchase, so one KPI could be the amount of brochures sent out that lead to conversions.</p>
<h2><strong>Web analytics measurement framework</strong></h2>
<p>Here is a framework proposed by Avinash Kaushik, which is very useful to prevent us from getting lost amongst the data and metrics.</p>
<p>The framework is split into 4 parts:</p>
<ul>
<li>Business objectives:  These are the answers to questions like “Why do I need this website?” or “What do I want from this website?”.</li>
<li>Goals are specific strategies that will help you to accomplish the objectives.  We can define some high level goals to help identify the specific activities we should spend our valuable time on.</li>
<li>KPIs: as I stated above, KPIs are the metrics attached to our goals.</li>
<li>Segments: Without segmenting the data, overall totals can often be quite useless, so the best way to find insight is to segment the data. For example, we could choose visitors who spend more than 2 minutes on the site and look at their activity specifically. These are the useful metrics we want to look for.</li>
</ul>
<p><strong> </strong></p>
<h3><strong>KPI examples for an online travel website</p>
<p></strong></h3>
<p>Now we could follow the framework and start to identify the KPIs for a Web Travel Site.</p>
<table width="560" border="0" cellspacing="0" cellpadding="0">
<tr style="border:1px solid #000000;">
<td width="130">Business Objectives</td>
<td width="197">Goals</td>
<td width="225">KPIs</td>
</tr>
<tr style="border:1px solid #000;">
<td rowspan="3">Make More Profits</td>
<td>More Sales</td>
<td>Revenue/Booking</td>
</tr>
<tr>
<td>Increase ROI</td>
<td>Increase ROAS (Return on Ad Spend)</td>
</tr>
<tr>
<td>More Visitors</td>
<td>Monthly Unique Visitors</td>
</tr>
<tr>
<td rowspan="3">Building Goodwill</td>
<td rowspan="2">Satisfied Shopping Experience</td>
<td>Browse to Book Conversion Rate</td>
</tr>
<tr>
<td>Sale Cycle (Time between first visit and purchase)</td>
</tr>
<tr>
<td>Serve as a resource for the travelling community</td>
<td>Pageviews of resource pages</td>
</tr>
<tr>
<td>Effective marketing</td>
<td>Good Campaign Performance</td>
<td>Campaign Conversion Rates</td>
</tr>
</table>
<p>After we define the Key Performance Indicators, we should start to think about what segmentations we should make in order to measure and improve the KPIs. For example, a KPI above is Revenue/Booking. So the segments we need might be:  what are the most popular destinations or hotels, where are is the traffic coming from or who looks at these hotels? <strong> </strong></p>
<p><strong> </strong></p>
<h2><strong>What else do we need to do with KPIs?</strong></h2>
<p>There actually is a one more thing we need to do with KPIs and that is to set KPI Targets.  They are the numerical values which are pre-determined as an indicator for success or failure. It is crucial to create the targets for every KPI. In order to set the number, we need to look over the historic performance. Without having a KPI target, you can collect all the data you want, but you won&#8217;t know if you are hitting your objectives or not.</p>
<p>That&#8217;s all for this week, check back next week for another look into the world of analytics.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/web-analytics/goals-vs-kpis-analytics-tips/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>An Opt-out for Google Analytics On the Way?</title>
		<link>http://www.wmps.com/blog/website-analysis/web-analytics/opt-out-for-google-analytics/</link>
		<comments>http://www.wmps.com/blog/website-analysis/web-analytics/opt-out-for-google-analytics/#comments</comments>
		<pubDate>Thu, 22 Apr 2010 09:58:50 +0000</pubDate>
		<dc:creator>Wei Shao</dc:creator>
				<category><![CDATA[Web Analytics]]></category>

		<guid isPermaLink="false">http://www.wmps.com/blog/?p=980</guid>
		<description><![CDATA[One day you might wake up to find your website’s traffic has taken a dramatic drop. Don’t panic! Your customers might just have opted out of Google Analytics and thus disappeared from your screen. Recently, Google announced plans to offer a Google Analytics opt-out: “Over the past year, we have been exploring ways to offer [...]]]></description>
			<content:encoded><![CDATA[<p>One day you might wake up to find your website’s traffic has taken a dramatic drop. Don’t panic! Your customers might just have opted out of Google Analytics and thus disappeared from your screen. Recently, Google announced plans to offer a Google Analytics opt-out:</p>
<p>“<em>Over the past year, we have been exploring ways to offer users more choice on how their data is collected by Google Analytics. We concluded that the best approach would be to develop a global browser based plug-in to allow users to opt out of being tracked by Google Analytics. Our engineers are now hard at work finalizing and testing this opt-out functionality. We look forward to make it globally available to our users in the coming weeks.”</em></p>
<h3>Why Google is offering an opt-out</h3>
<p>When I first saw this news, I naturally recoiled at the idea of voluntarily allowing measurable data to slip through our hands. Rationalizing web analytics data is already hard enough, and now it will be even harder.</p>
<p>But I was not surprised. There are increasing concerns about privacy issues and Google’s products. This week, a open letter co-signed by officials in privacy commissioner roles in France, Germany, the Netherlands, the UK and 10 other countries was sent to Google&#8217;s CEO Eric Schmidt, raising concerns about privacy issues in Google Buzz and Google Street View.</p>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/04/lock.jpg" rel="lightbox[980]"><img class="aligncenter size-medium wp-image-982" title="Privacy lock" src="http://www.wmps.com/blog/wp-content/uploads/2010/04/lock-300x213.jpg" alt="Privacy lock" width="300" height="213" /></a></p>
<h3>What does this opt-out mean for Google Analytics Users?</h3>
<p>In my opinion, it is highly doubtful that this will do any substantial harm to Google Analytics and its users. Here is my point of view:</p>
<p>First of all, not all users will know about the opt-out plug in, and only a few of them will actually download and install it. And most of those people will be privacy fanatics who might have already blocked the cookies or enabled javascript to make themselves invisible on the tracking list.</p>
<p>Second, even if we assume that there are some people who will undoubtedly adopt the opt-out plug in, it&#8217;s still unlikely to strike a deadly blow to web analytics. As far as I know, web analytics is more concerned about data trending, not the data numbers themselves. So even if the numbers drop a little, the trending data will remain valuable for web analytics.</p>
<p>And Google are not foolish enough to kill their own business. If the new plug in did have a negative impact on Google Analytics in the future, Google would find a way around it.</p>
<h3>3 Ways to Prepare</h3>
<p><a href="http://www.wmps.com/blog/wp-content/uploads/2010/04/butterfly-nolegs-2.jpg" rel="lightbox[980]"><img class="alignleft size-medium wp-image-983" title="Butterfly" src="http://www.wmps.com/blog/wp-content/uploads/2010/04/butterfly-nolegs-2-300x217.jpg" alt="Butterfly" width="180" height="130" /></a>Even the flutter of a butterfly’s wing can affect a tornado, so the opt-out plug in will definitely have an impact. There are some things we should start thinking about before it goes live.</p>
<ol>
<li>Benchmark our traffic and known visitors before and after the release of the Opt-Out so we can evaluate the impact on our traffic measurement and whether the traffic drop-off is correlated to the visitors we need to meet our site’s goals.</li>
<li>Be ready to accommodate the bias that Google Analytics opt out incurs on our metrics.</li>
<li>Be ready to have another analytics tool as a backup.</li>
</ol>
]]></content:encoded>
			<wfw:commentRss>http://www.wmps.com/blog/website-analysis/web-analytics/opt-out-for-google-analytics/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>
