|03 Nov 2009||#1|
Data Driven Engineering: Tracking Usage to Make Decisio
Hello, my name is Peter and I work in the Office Trustworthy Computing (TWC) team. One of my team’s areas of focus is collecting data on how various applications are being used so we can make informed decisions. You’ve probably seen, and based on the comments received to date, have used our Send-a-Smile feedback tool. In addition to that type of qualitative feedback, the last 3 versions of Office have included telemetry through the Customer Experience Improvement Program (CEIP) to help us understand how applications are being used. The combination of qualitative and quantitative data provides valuable insights for making informed design decisions.
What is the Customer Experience Improvement Program?
In short, the CEIP is an anonymous opt-in program that helps us improve Office. If you opt-in to the CEIP, anonymous data about how you use Office are uploaded to Microsoft occasionally in the background.
When you run an Office 2010 application for the first time you are asked about what settings you want to apply to ‘Help Protect and Improve Microsoft Office’ and the CEIP is included in the Recommended Settings. You can also find this in the Privacy Options of the Trust Center. In previous versions, opt-in was through a “Help Make Office Better” balloon that would pop up the first time you ran Office.
Of course, we respect your privacy and don’t collect any information that could identify you or your data personally. Your anonymous data is combined with millions of other users to provide us a broad picture of how people use Office.
What do we collect?
We collect a lot of information on our applications, too much to enumerate in a blog post. The engineering teams have defined data points that they are interested in learning about, and added those to the software for data collection. They typically fall in the following categories:
How do we use the data?
Before we had the data from customers participating in the CEIP, design decisions were quite often based on consulting people who had worked on the product for a long time (opinions) or personal observations of, say, someone’s family members (anecdotes). If you were lucky, you had some data from the researchers in the Office Design Group or a survey done by the Planning team. There was data, but it was from a constrained sample of users, rarely data from real users, doing real work. Throughout the development of the Office 2003 release, the Office teams began leveraging the CEIP data to better understand how real users used the Office applications. With every release, we’ve grown our toolset and have a richer understanding and appreciation of real-world usage data.
For many of the Office 2010 design decisions, we leveraged this usage data to answer questions based on how real customers actually use the applications. To provide a single example, take the question on whether the Ribbon should be collapsed when users were in a particular view in PowerPoint – the discussion was on whether users could still figure out how to start a slideshow. We have a few different entry points to start a slideshow and the reporting tool showed how often each was used.
Based on the Command Name and the ID, we know that the one showing 65.9% is not on the Ribbon, but still a significant number of users (25.6%) click the Ribbon. We can drill down even further and see that the vast majority of users access the Slideshow command through the status bar instead of using a hotkey.
While the design process involves more than just data, this example shows how your participation in the CEIP can replace the opinions and anecdotes from ‘experts’. Knowledge about actual usage is extremely valuable and ultimately puts us in the position to make intelligent decisions and create a better product for you.
In future posts we will give you an overview of other feedback mechanisms we use to improve the product, such as error reporting to find and fix reliability issues, as well as a tool to collect data for performance and responsiveness issues.
I look forward to reading your comments and questions on how we use data during the development cycle.
Peter Koss-Nobel, Senior Program Manager Lead, Office Trustworthy Computing
|My System Specs|
|Similar help and support threads|
Unexplained Hi Usage of Data
Hi Win7 My data usage thru ISP has increased a large amount. From 30G per month to 100 G per month. Not sure what it is. Have router with 2 wireless laptops and 1 internet capable tv (cable and not used much) My ISP has proved several dates and times from last week for data usage of about...
software to monitor devies on network, data speeds, data usage ?
Hello, I have a number of devices connected to my virgin router, via wireless and lan. I was wondering if their was software that exists, that allows you to monitor the speed, traffic, and what kind of bandwidth each device is getting from the router, speed etc too . Many thanks, ...
I got curious and enabled the data tracking feature of Windows 8 to see how much data I am using. I'm not on a metered connection, so it doesn't matter that but much, but its interesting. In the past 6 days, I've apparently transferred a total of 31 GB. I'm curious to know how much other people...
I have just bought a Dell Inspirion . I live in Mexico and use a Telcel 3G internet stick. This connects to internet using cell towers. I pay a monthly payment for 3Gigs of data . I can monitor my data useage by going to Networking and shareing in control panel , click on my connections under...
|Network & Sharing|
high cpu usage with streaming data program
Hello fellow bloggers, I am baffled by an issue with my HP Pavilion dv7 windows 7 notebook using an AMD mobile m520 cpu maxing it out when running a gui real time streaming data stock market monitoring program. During peak market hours the cpu usage peaks and the program runs between 35 - 60%...
|Performance & Maintenance|
Any Software that monitors your data usage?
actually m using Broadband which have 2.5gb free usage per month .. above 2.5gb i hav to pay.. so i want a soft which tells me u hav reached to 2.5 gb usage or restrict me above it... so help me
© Designer Media Ltd
All times are GMT -5. The time now is 13:00.