Trust, But Verify

An old proverb says: “Trust, but verify”. When it comes to Advanced Work Packaging (AWP) software, I couldn’t agree more.

If you are selecting software for AWP, there are several vendors out there that claim to support it, so you will be spoilt for choice. But the true task here is in sorting the wheat from the chaff, and understanding which one will meet your needs.

Where to Start

The best place to start is to create a rigorous technical specification. Think of this as hundreds of lines of “Must be able to do this, and this, and this”. Be as specific, detailed, and pedantic as possible. Nothing is too granular at this point. (We have one for free on our website if you want a place to start). Then each of the vendors can tell you whether their tool can do what you need. Follow this process up with a demonstration. Challenge the vendors to show you all the functionality that they claim. If they can’t show it to you, it likely doesn’t exist.

Why You Should Request a Pilot

Implementing artificial intelligence in AWP software can be complex, and it is crucial to create meaningful, impactful solutions that address specific business needs. But then you get to the last step, and this one can make all the difference: If you aren’t 100% sure which vendor to choose at this stage, insist on a Pilot. This is where you provide your data to the vendor and ask them to show it to you in their system. Typically this is done using information from a recently completed project or one that you are currently working on. Your evaluation team should then get access to the AWP software that has your data in it, and they can test out all the requirements.

Anyone can make their software look good with pre-canned data that they have polished and refined over the years. The true test is in handling new data. Your projects will always have new data, so being able to work with that is a key part of the process.

Here are the things to look out for when doing a Pilot Project:

1)      “No.” This is the most obvious. If a vendor won’t agree to do it, this is a huge red flag. It typically indicates that they don’t believe their software can do what they say it can.

2)      Cost. If the price is too high, it probably means that they are going to have to expend a huge effort to get it working. If that’s the case with the Pilot data, it will only be worse when you try to do a real project.

3)      Timing. How long it takes to upload your data is a good indication of how sophisticated the tool is. If, for example, it takes a week to perform a complex “end-to-end run” to upload your model file, you can see in advance that you will always have delays with processing this kind of data.

4)      Resources. If you find yourself dealing with dozens of people from the vendor side, it means their tool takes a lot of manual effort to stand up. Look for vendors with a lean and automated process.

5)      Data Blame. If the vendor tells you that your data won’t work for a Pilot, or there are problems with it that they can’t overcome, that’s a sign that their tool will only support perfect data. Sadly, most real-world projects don’t have perfect data, so you need a tool that can support whatever data quality you have.

6)     No Success Criteria. If the Pilot does not come with clear success criteria, agreed upon by both the buyer and vendor, there will be no way to make an informed decision on if the Pilot was successful.

Get It Right with a Pilot Project

So, as the proverb says, “Trust, but verify”. This could be a massive decision for your company, and you want to make sure that you get it right. So do your due diligence, and check that what you are being sold can do what it claims. This Pilot could save you from months or years of scrapping with a bad tool.

An incremental approach to integrating AI into business operations through Pilots can prove the value and viability of AI solutions.

At O3, we know our tool works, and we are more than happy to show that to you through a Pilot. A measured, incremental strategy in AI implementation is essential to refine and tailor solutions to meet your specific needs.

To learn more, request a personalized demo and we’ll discuss how to kick-off a Pilot Project with O3.