Transparency is one of the guiding principles of our community.
Please see the following FAQs for answers to frequently asked questions.
How to submit a new product and how much does it cost?
Standard WhatMatrix listings are free! There is neither a reoccurring fee nor a subscription dependency for being listed!
The initial submission can be free or generates a one-off service fee – details below:
Community-submitted publications are free (preferred method), “WhatMatrix On-boarding” incurs a “one-off” service fee – details below.
1. Community-submitted: comparison data must be generated and submitted by an (independent) community specialist
Data generated by: Vendor-independent specialist (not provided by WhatMatrix)
Data curated by: WhatMatrix Category Consultant / board
Turnaround time: Subject to queue and availability of category consultant [inquire availability]
Please note that the onboarding option is included with any Enhanced Listing
Data generated by: WhatMatrix Consultant(vendor must support with named contact)
Note to vendors: Data curation will always be independent of the submission type and will never influence the ratings to ensure impartiality.
How can vendors provide updates for new releases? How often are the comparisons updated?
There are no scheduled “update cycles” – that’s the inherent advantage (and challenge) of our “always online” comparisons. Historically evaluations are done in “reports” that are outdated by the time they are published. Our approach reflects modern application development with continuous release cycles.
This is not new to us – we have been dealing with vendors successfully on “rolling” updates since 2011.
Please note that each vendors have 2 free update slots per calendar year (reflecting typical minor/major product releases) but they can request additional updates for a service fee if really required.
Matrix updates are triggered by new product releases. We make input templates available to the nominated product specialist or work directly with the vendor to generate the raw data, which is then curated by the category consultant (comparison owner), the category specialists and peers in our community.
(if the product is unknown / new to the category consultant, the vendor can help by identifying a suitable category specialist i.e. ‘product specialist’ to work with the category consultant on the integration)
Vendor guidance: Timeline for updates and “change requests”
Scenario: Vendor “A” has announced a new product release (or will announce it “shortly” – features must be “committed”)
1. Vendor “A” can now submit new content for evaluation to WhatMatrix – typically working directly with the WhatMatrix consultant(s)
2. WhatMatrix Consultant(s) will curate and incorporate updates and post a non-public draft for review, no later than 4 weeks after the submission (typically faster).
3. Consultant(s) will collect input /challenges from Vendor A, then perform a final evaluation that is subsequently posted publicly.
4. WhatMatrix will promote the content as appropriate
Vendors can submit new content when their new release becomes available (GA) or use the existing change request function via the details popup if they spot an empirical mistake (any time).
In addition the above “change / feedback” button (accessible directly from each individual “details popup”) allows anyone to submit change requests to us at any time (typically implemented no later than 4 weeks if accepted).
Do you include pre-GA or Beta product releases in your listings?
We are only listing products and features that have been formally announced and are committed in a product release as production feature.
We can list non-production features (e.g. tech-previews) as “for information only” in the details popup of a feature – but will NOT include an uncommited or pre-production feature in any evaluation (matrix score/evaluation color)
Who are yor consultants and can I potentially become one?
WhatMatrix evaluates products through independent community consultants (typically individuals or specialized consultancy outlets) that are not directly affiliated with (employed by) a vendor included in the comparison to ensure agnostic evaluation results.
WhatMatrix has two types of community consultant:
1. Category Consultant
The Category Consultant is responsible for the structure and content of an entire comparison, from the creation and maintenance of the category taxonomy to the balanced curation of all product evaluations within that category.
2. Product Consultants are responsible for the evaluation of specific products within a category. They typically work with the Category Consultant to ensure data is correct, up-to-date and curated for a specific product.
Want to become a community consultant yourself?
If you want to host a new comparison (Category Consultant) or want to become the Product Consultant for a new vendor in an existing category – please get in touch!
You can go to https://www.whatmatrix.com/portal/community/ and propose a new comparison / product – or – simply send us an email (info@WhatMatrix.com) outlining the proposed topic (including proposed vendors & products) or the product that you would like to consult for as part of an existing comparison (product consultants).
We will always engage with you to validate topic suitability, personal experience and share background and expectations for becoming a WhatMatrix category consultant.
If we jointly decide to go ahead you will be guided through the on-boarding process and welcomed into the community.
How do you ensure your category consultants are qualified and experienced experts ...? Who determines the evaluation criteria for a comparison?
Our community has a 3-phase onboarding and review mechanism for accepting consultants to publish on WhatMatrix.
During this process the experience and qualification of the potential consultant are peer-reviewed, alongside with the suitability of the proposed comparison based on structure, content and consistency. In addition an assigned community board “mentor” will directly assist with the on-boarding and iniial publication.
Note: We are spending a significant amount of time working directly with vendors to understand their requirements and preferences but will NOT consider structural changes that favour a particular vendor or product! Typically our consultants publish personal information, such as experience and qualification, however we do not (and will not) obligate them to do so. Ultimately WhatMatrix stands behind the curation mechanism.
What if I disagree with an evaluation or spot a mistake?
We always invite feedback from the wider IT community and vendor ecosystem on the published data! Open community curation, opportunity for structured vendor input and transparancy on our evaluations is a key value of WhatMatrix.
If we are notified of published technical information which is empirically inaccurate, we will strive to correct this within a reasonable timeframe (typically 3 business days).
Please see this Blog article for details including “how to submit a change requests”.
So if you disagree – please get in touch!
If evaluations are disputed we will always try to engage with the claimant in attempt to resolve, however we reserve the right to maintain our independent evaluation in order to provide agnostic comparisons.
What is the 'Matrix Score' and how important is it to the site visitor / consumer of the information?
The matrix score reflects the accumulated individual scores but should not be used “blindly” or seen as “absolute” ranking – especially when scores are close between vendors or the consumer has specific deployment scenarios.
I want to propose a new comparison category - what should I do?
First of all – please get in touch! 😉
You can go to https://www.whatmatrix.com/portal/community/ and propose your comparison – or –
Simply send us an email (info@WhatMatrix.com) outlining the proposed topic (including potential vendors & products).
We will always get back and engage with you to validate topic suitability, personal experience and share background and expectations for becoming a WhatMatrix category consultant.
If we jointly decide to go ahead you will be guided through the onboarding process and welcomed into the community.
What are "Enhanced Listings"?
As stated before – all listings on WhatMatrix are (and will remain) free to ensure our unique impartiality evaluating these products.
Vendors can however significantly improve visibility and impact of their listing by upgrading to one of these options.
Please note that “enhanced listings” will never influence any product rating!
What are the benefits of an "Enhanced Listing"
Enhanced listings can significantly improve the visibility and impact of a product listing.
The free listing gives vendors a unique way to promote their products online, educate their audience and attract new customers.
However – by default all vendors, products and editions are listed randomly (!) i.e. visitors might (or might not) see the product or select it for an evaluation (e.g. despite leadership).
Enhanced listings guarantee that EVERY visitor to the comparison will see the enhanced product and edition (populated by default).
The enhanced product is highlighted prominently and we enable an interactive Product Profile Card that provides users with useful links to assets, promoted use cases, benefit analysis and even free product advise and lead gegeneration options.
In addition we can help publicise the listing through social media activities (see all options)
Want another question answered? Just ask it in the below ‘comment’ section and we’ll get back to you!