Archive for the ‘Performance Measurement’ Category

If I Could Be a Government Web Site Manager

Thursday, April 1st, 2010

By Denise Eisner

I work alongside some very dedicated, passionate web people in government. They want to have web sites that are usable, readable and of value to the audiences they’re intended to reach. For reasons both obvious to those in government and to anyone else who has tried to push new ideas in large organizations, there’s a set of what we euphemistically term “challenges” to achieving these goals.

But let’s say for a moment that said challenges were surmountable and the HIPPO (Highest Paid Person in the Office) was giving me carte blanche to run the web site per accepted best practices and the latest in research-driven design principles. Wow! Colour me happy!

Quick, before the HIPPO changes his/her mind, here’s my wish list:

  • Double the size of the web team – No site that is designed to reach audience segments as vast and varied as those served by government sites can be run with two people, neither of which have time to strategize, plan, write, edit, apply metatags, code, test, and perform quality control, all while responding to the latest request to convert a 200-page report to HTML. Scale the team to the size of the site really needed by users.
  • Let my team control the site design – Everyone has opinions but design by opinion war only leads to chaos and bad feeling. I’ll consult with stakeholders, sure. I’ll amass quality research to back up my ideas and proposals (web metrics, surveys, usability tests, etc.). But I’ll make all high-level design decisions regarding navigation, breadcrumbs and landing pages. And I’ll be able to defend those decisions with data.
  • Have dedicated IT resource(s) on the Web team – Rather than have the disconnect that can exist between varying business units, combine the various skill sets needed to have a strong web group capable of supporting high-quality content and web infrastructure.
  • Publish good content, not FAQs – I was recently inspired by R. Stephen Gracey’s post on how FAQS “seem to constitute a basic instruction manual or else call attention to selling features, making them only marginally useful to users with real questions.” I want good writers to develop quality, searchable content and an editor to oversee publishing standards.
  • Help me get the web strategy approved – I need senior support for defining why we need a web site and who we really serve (beyond the catch-all “all Canadians”). This will help me maintain a focused web operation that strategic, not reactionary, and supports our business priorities.
  • Approve a governance model for the web – In order to make informed, strategic decisions around the web, particularly for the aforementioned strategy, let’s implement the roles we defined for a web champion, working group, ad hoc teams and steering committee.
  • I’ll just do Web 2.0, now – Hey, I’ll start a blog! I found a SME who’s willing to share his/her expertise with a specific audience (teachers, businesspeople, scientists), so I added the blog to the site, moderated it myself, and can report the site activity to management. It involves extra work but as EPA web 2.0 guru Jeffrey Levy told me last year, you learn by doing. We’ll keep an eye on performance and keep tweaking it as needed.
  • Good measurement tools – You only can manage what you can measure. Let’s get the right tool and get a professional to configure it according to our performance indicators. I can help find efficiencies if I have good data to present to senior management.

Quite a wish list, but these approaches all point to effective site management.

Google – Better on the Outside than on the Inside?

Tuesday, February 23rd, 2010

By Lindsay Fraser

My all time favourite Far Side cartoon features two polar bears looming over an igloo.  One says to the other: “I just love these things – cool and crunchy on the outside, warm and chewy on the inside”.

This cartoon comes to mind whenever I am talking to colleagues about the use of Google on Canadian government intranets. I can’t help but think that Google is better on the “outside” than it is on the “inside”.  Now, don’t get me wrong, I am not a Google-basher. I love Google. I love Google today the way that I loved and adored Yahoo back in 1994, when I couldn’t imagine anything better.

Google is a tremendous resource, second only to GEDS in my personal favourites list. It is such a marvelous Internet search engine that it leads decision makers to think “anything that good must be a great solution for our intranet too – right?”

NO, No, an emphatic no.  And I hate to say it – I really do.

I am the first to agree that any search is better than no search – absolutely.

But the black-box that is Google does not typically help workers inside the organization find the materials on the intranet that are best suited to their working requirements.

Granted, we don’t understand all that well how the Google algorithms work (a closely guarded secret as you might well appreciate); but we do understand that Google focuses on concepts such as word counts, proximity of words to other words, location of words in web pages (titles, top of page) etc. This focus allows Google to do a great job of bringing to its users potentially relevant returns from a massive and totally random world wide web.

But on the inside, where the information collection is much smaller, far less random and actually has some structure and logic to it, Google’s effectiveness is greatly reduced. Employees want access to particular types of information (leave forms, for example), and don’t want a results set that contains every instance of the word “leave”.

Employees also want easy access into the top level of various information resources (the key entry and summary documents) so they can understand the context of the information returned to them and then choose the depth to which they will perform their reading and analysis.

Owing to significant challenges at the time, Google designed its algorithms to foil search engine spammers and other unreliable publishers who were misrepresenting the nature of their information content in order to have it come up in as many relevant results lists as possible. Google couldn’t trust that the information that publishers provided in association with their Web resources (metadata) was truly reliable and therefore built algorithms that placed little credence in such data.

Internally though, organizations understand their information holdings and understand who the users of said holdings are. Organizations also have information architects, publishers and editors, who can assign reliable metadata such as objective indications of page importance, page “type” in a hierarchy and resource type (e.g. form, policy etc.). It is this trusted metadata that allows search engines to return truly relevant search results to organizational users – and sadly, metadata is not something that Google has been developed to exploit.

For internal intranet search purposes, organizations should look to search tools and appliances that will also allow for the rich exploitation of trusted publisher input. If Google is the only option, then organizations should look to acquire the most flexible of the Google offerings and to take full advantage of the “weighting” options that are available. Google is undeniably great – but perhaps better on the outside than on the inside.

Lindsay Fraser is the Principal and Practice Lead for Systemscope’s Information Management practice.She can be reached at fraser@systemscope.com.

Web Usability as Part of Your POR Planning

Saturday, October 24th, 2009

By Denise Eisner

As government departments and agencies ramp up efforts to measure their websites’ performance, they increasingly look to usability testing as one of several tools available to gauge user acceptance and satisfaction and make site improvements. A new set of guidelines by Treasury Board in effect as of June 9, 2009 however demands a new approach in planning usability tests by defining this research approach as public opinion research (POR).

“Quality of service/customer satisfaction studies” is defined in the TBS procedures as POR. What does this mean for Comms and IT teams planning usability testing in the near term or next fiscal year?

If your usability testing is planned before fiscal year end, the procedures stipulate that approval comes from the minister or equivalent role per the Financial Administration Act. Given the challenges in bringing such a request to that level in time to conduct testing by March 31, the risk to web projects is high.

The good news is that web teams have time to prepare their annual POR plan for next fiscal year. Find a management champion to support the project, then get together a small group of stakeholders from the appropriate teams to build a proposal. Present your approach to management for consideration and approval according to your organization’s planning timelines.

How to prepare your usability plan for next fiscal

After you have thoroughly digested the TBS procedures, build a solid case for your future usability testing by including these components in your proposal:

  • Project Background – tie the methodology to your business and site goals per your Report on Plans and Priorities, other departmental/agency planning documents and the website strategy
  • Information Needs – define specifically the goals of the research
  • Partnerships – specify any extra-departmental partners and explain the nature of these partnerships
  • Rational and Intended Use of Research – How the research will support department or government priorities, benefit Canadians, and is prescribed by legislative, policy, evaluation or litigation requirement. Also specify the privacy risks of collecting information, if appropriate.
  • Target Populations – description of the participant demographics
  • Methodology and Scope – method for collecting data with detail on any personal information to be collected
  • Deliverables – nature of research outputs, i.e. format
  • Anticipated Timeline – when the research will be conducted and the deliverables completed
  • Budget – costs for contracted services, etcs.
  • Project Authority – name and title

Ideally, your proposal will reference a completed Annual Research Plan which is associated to an overall performance measurement framework approved by senior management. In the absence of those key guidance documents, strengthen your proposed approach by tying your usability testing goals to future development of these web channel components.

MANAGING INFORMATION IN THE PUBLIC SECTOR
April 26-27, 2010
- Architecting for the E-Record, presented by Linda Daniels-Lewis. Read More

Procurement - Talk to us about
TBIPS and SBIPS! Read More