I am getting an error message when I do a reliability analysis

Post by E S
Error Message: "The value is negative due to a negative average
covariance among items. This violates reliability model assumptions.
You may want to check item codings."
I am trying to run a reliability analysis and the above error message
appears with my results in relation to the cronbach's alpha if item
deleted. I am certain that everything has been reverse scored, so I
can't figure out why this message is appearing. any ideas?
Thanks

I can help you if you can send me your data set.
Frank

i***@hotmail.com

2013-06-25 13:10:46 UTC

I can help you if you can send me your data set.
Frank

Anyone can help me to see whats the problem of my reliability analysis? i kept get negative result on my variables.

Rich Ulrich

2013-06-26 00:42:27 UTC

Post by i***@hotmail.com

I can help you if you can send me your data set.
Frank

Anyone can help me to see whats the problem of my reliability analysis? i kept get negative result on my variables.

WHERE DOES THE SCALE COME FROM?
- Reliability looks at "internal consistency", so it expects
all the items to be measuring a common dimension.
- On the other hand it *is* possible to have a scale that
measures items that are *supposed* to be separate and
independent, or even negatively correlated. You would have
no expectation that Relability would say anything useful
about that sort of scale.

If this is scaling a single, simple dimension, you should be able to
tell whether High vs. Low always codes to mean the same thing
simply by reading the items.

Otherwise. Mechanically.
Look at the correlation matrix of your items. There should be
zero or very few negative r's among the items that are
supposed to make up one scale.

If "Item_07" has mostly negative correlations, then
you want to use, instead, the reverse-scored version
of it, Ritem_07.

If the scoring is, for example, 1-4, you can reverse it with
COMPUTE Ritem_07= 5- Item_07 .
- If it was 0-4, then you subract from 4 instead, so the new
minimum will be 0.

--
Rich Ulrich

a***@gmail.com

2014-04-01 19:25:31 UTC

I can help you if you can send me your data set.
Frank

the same problem. maybe you can help me?

Art Kendall

2014-04-01 21:28:55 UTC

The usual cause of this is that some items have negative correlations
with other items.

Good scale construction practice to to reduce response bias by wording
some of the items in a scale so that agreement (or high extent)
indicates the high end of the construct and other items so that
agreement (or high extent) indicated the low end of the construct.

Check you scoring key should some of the items be "reflected"?
If the items are grouped via factor analysis did some load positively
and some load negatively on the factor that was used to build the scale?

Art Kendall
Social Research Consultants

Post by a***@gmail.com

I can help you if you can send me your data set.
Frank

the same problem. maybe you can help me?

Rich Ulrich

2014-04-01 21:53:12 UTC

Post by a***@gmail.com

I can help you if you can send me your data set.
Frank

the same problem. maybe you can help me?

Check your syntax:

Did you create new variables for a few items that
are reversed? Does Freq show that the Missings are
handled properly for the new ones?

Did you use *those* variables (instead of the old ones)
in Reliability? ... so your list in a scale might read
"var1 to var4, revers5 to revers8, var9 var10".

Look at the correlations in the correlation matrix, when
you request it. How many are negative? ... if there are
more than a couple, figure out what is wrong with the
coding of the biggest negative r or two.

--
Rich Ulrich

masvelous

2014-12-01 02:18:07 UTC

Hi frank,

i'm currently having the same problem too. can you help fix mine as well ?

David Marso

2014-12-01 14:06:55 UTC

Perhaps you should pursue some of the advice provided by several people in this thread? At minimum post your correlation matrix?

Post by masvelous
Hi frank,
i'm currently having the same problem too. can you help fix mine as well ?

s***@gmail.com

2020-03-15 07:37:12 UTC

I am trying to apply reliability analysis but I get reliability in negative

Rich Ulrich

2020-03-17 16:50:09 UTC

Post by s***@gmail.com
I am trying to apply reliability analysis but I get reliability in negative

Rescore the particular items which are opposite in direction
from how you want to interpret your overall score.

If an item is scored from 1-5, you can reverse the scoring by
COMPUTE rvar= 6- var . And so on.

In order to keep your file accurate with its original variables,
you should NOT simple reverse-score an item in place, unless
you make sure NOT to save the file with the reversed score.

When there are only a couple of vars that need reversing, I've
been satisfied with creating new versions of only those couple,
so my file might end up with (say) "var1 to var10, rvar4, rvar8".

Reliability is computed from formulas that have several important
assumptions, and add and subtract "variance components".
The important failure-of-assumption is that your correlation
matrix apparently does have sizable negative r's.

LOOK at the correlation matrix that can come with the analysis,
to make sure that you are looking at a consistent set.

--
Rich Ulrich

Rich Ulrich

2009-08-20 04:08:38 UTC

Look at the correlation matrix and SEE what is negative.

While you are at it, making sure that you know what data
you have on hand, look at Frequencies on all the variables,
and make sure that your MISSING are all coded as Missing,
and that there are no oddball scores.

If correlations of good data scatter randomly around zero,
then you apparently do not have a scale with internal
reliability worth mentioning. (That ordinarily would
seem to indicate that you have totally *misread* your
input data, or you are using the wrong variables.)

Of course, if reversing scoring *everything* was a
precise statement, then it achieved nothing, and you
would need to go back and reverse-score a subset that
would scale the latent dimension in a consistent direction.

--
Rich Ulrich

Ray Koopman

2009-08-20 08:55:07 UTC

Post by E S
Error Message: "The value is negative due to a negative average
covariance among items. This violates reliability model assumptions.
You may want to check item codings."

The error message is wrong. A negative alpha does not violate any
assumptions of the reliability model. The error is in interpreting
alpha as the reliability. In general, alpha is only a lower bound
for the reliability. Only in the special case where the items are
essentially tau-equivalent does alpha equal the reliability. Since a
reliability can not be negative, a negative alpha simply provides no
information about the reliability. See Lord & Novick, _Statistical
Theories of Mental Test Scores_, Theorem 4.4.3 and Corollary 4.4.3b.

Rich Ulrich

2009-08-21 04:49:59 UTC

Post by Ray Koopman

Post by E S
Error Message: "The value is negative due to a negative average
covariance among items. This violates reliability model assumptions.
You may want to check item codings."

Ray,
I'm not unhappy with the message.

I think that my "model assumption" includes the idea that
there is a latent dimension which is readily discernible.
Doesn't that say, "There isn't"?

--
Rich Ulrich

Ray Koopman

2009-08-21 07:43:09 UTC

Post by Ray Koopman

Post by E S
Error Message: "The value is negative due to a negative average
covariance among items. This violates reliability model assumptions.
You may want to check item codings."

Ray,
I'm not unhappy with the message.
I think that my "model assumption" includes the idea that
there is a latent dimension which is readily discernible.
Doesn't that say, "There isn't"?
--
Rich Ulrich

A readily discernible latent dimension may be desirable, but it's not
part of the reliability model. At the univariate level, for each item
separately, the model is tautological and contains no assumptions. At
the multivariate level, when the items are considered together, the
only assumption is that the errors of measurement are mutually
uncorrelated.

s***@gmail.com

2013-07-20 08:33:49 UTC

Art Kendall

2013-07-20 10:41:40 UTC

use the options to see the correlation matrix. look at items that have
negative correlations. Are you sure you used the reflected variables
and not the original variables?

Art Kendall
Social Research Consultants

m***@gmail.com

2015-07-21 01:03:03 UTC

Hi,

Anyone can help me?Please~
I have the same problem too.
Before reverse coding, cronbach alpha for 10 items of attitude is 0.764.
But, after I have reversed coding the 5 items of negative statements, cronbach alpha become 0.331.

Thanks.

Rich Ulrich

2015-07-21 07:20:04 UTC

Post by m***@gmail.com
Hi,
Anyone can help me?Please~
I have the same problem too.
Before reverse coding, cronbach alpha for 10 items of attitude is 0.764.
But, after I have reversed coding the 5 items of negative statements, cronbach alpha become 0.331.
Thanks.

Dammit, if you are going to write as a Reply to a message from
2009, please have the consciousness to know that WE do not
read via Google-Groups, so WE do not have the text of that message
unless our ISP has saved it. Here:
****from 2009.
Error Message: "The value is negative due to a negative average
covariance among items. This violates reliability model assumptions.
You may want to check item codings."

Case Description:

I am trying to run a reliability analysis and the above error
message appears with my results in relation to the cronbach's alpha
if item deleted. I am certain that everything has been reverse
scored, so I can't figure out why this message is appearing. any
ideas?
****end 2009.

0) (Your report of numerical results seems unlikely
to be fully accurate.)

1) I'm surprised if there wasn't an Reply in 2009. Did you look
for one?

2) ERROR says you must have some negative correlations.

So, LOOK AT the correlation matrix. Is everything
positive? It is an option in Reliability, or you can just
get correlations.

The popular error is to compute the reversed score
with a new name (good idea) but to feed Reliability
the original set of names. Oops!

Less often, you may have merely screwed up while
trying to reverse the scores. As a check: The
original matrix (with some reversed scores) should
be exactly the same as the corrected matrix, except
for reversed signs whereever only one of the variables
had to be reversed.

--
Rich Ulrich

Rich Ulrich

2015-07-21 07:23:10 UTC

- I see that I also answered this in 2013 and 2014.
Does Google Groups hide those previous answers?

--
Rich Ulrich

a***@gmail.com

2015-10-04 16:26:42 UTC

Hey can you please help me. I'm getting negative sum in my SPSS relability test. And I'd checked all my data is correct. What should I do to make this answer positive?

Rich Ulrich

2015-10-04 18:19:51 UTC

Post by a***@gmail.com
Hey can you please help me. I'm getting negative sum in my SPSS relability test. And I'd checked all my data is correct. What should I do to make this answer positive?

Does Google-Groups reallly make it difficult to look for the
messages up-thread?

Three minutes before I posted what your Reply references
directly, I posted (a repetition of answers from years ago)
some details that include -

****From July, 2015
2) ERROR says you must have some negative correlations.

So, LOOK AT the correlation matrix. Is everything
positive? It is an option in Reliability, or you can just
get correlations.

The popular error is to compute the reversed score
with a new name (good idea) but to feed Reliability
the original set of names. Oops!

Less often, you may have merely screwed up while
trying to reverse the scores. As a check: The
original matrix (with some reversed scores) should
be exactly the same as the corrected matrix, except
for reversed signs whereever only one of the variables
had to be reversed.
****End excerpt.

--
Rich Ulrich

Bruce Weaver

2015-10-05 18:42:06 UTC

Post by a***@gmail.com
Hey can you please help me. I'm getting negative sum in my SPSS relability test. And I'd checked all my data is correct. What should I do to make this answer positive?

Does Google-Groups reallly make it difficult to look for the
messages up-thread?

--- snip ---

No, it does not! I am reading via Google Groups right now, and can see a message dated 18-Aug-2009 that appears to be the original message in the thread.

https://groups.google.com/forum/#!original/comp.soft-sys.stat.spss/IVp-wCTSxR8/alQsUu4hFIEJ

HTH.

Rich Ulrich

2015-10-12 23:11:33 UTC

On Mon, 5 Oct 2015 11:42:06 -0700 (PDT), Bruce Weaver

Post by Bruce Weaver

Post by a***@gmail.com
Hey can you please help me. I'm getting negative sum in my SPSS relability test. And I'd checked all my data is correct. What should I do to make this answer positive?

Does Google-Groups reallly make it difficult to look for the
messages up-thread?

--- snip ---
No, it does not! I am reading via Google Groups right now, and can see a message dated 18-Aug-2009 that appears to be the original message in the thread.
https://groups.google.com/forum/#!original/comp.soft-sys.stat.spss/IVp-wCTSxR8/alQsUu4hFIEJ
HTH.

Thanks.

Someone in the alt.usage.english group has suggested
how these posts appear, and why our responses to them
are useless.

A Google search, if it is particular enough, may bring up
some old usenet post. - When I do this, there is a button
up on the right that, when I pass the cursor over it, it
asks me to log-in if I wish to reply. (Is it more obvious if
you are already logged in to Google?)

When the searcher knows nothing about Usenet groups,
that person who posts a Reply is almost surely expecting
an email response; and they don't know a thing about
"reading a group", such as, "reading the previous post."

In the case of the folks who are posting in reply to
these spammed lists of manuals, we may notice that they
are clueless enough that they are *not* following the
instructions, to click on the site or to use the email address.

--
Rich Ulrich

a***@gmail.com

2015-10-04 16:26:51 UTC

Hey can you please help me. I'm getting negative sum in my SPSS relability test. And I'd checked all my data is correct. What should I do to make this answer positive?

p***@gmail.com

2016-01-06 07:13:13 UTC

I had analysed alpha cronbach but it was showing that The value is negative due to a negative average covariance among items. This violates reliability model assumptions. You may want to check item codings. im using scale 0 until 5. Perhaps, the problem is scale 0. please coment and share for this.

David Marso

2016-01-06 18:03:50 UTC

You obviously have something reverse scaled resulting in negative correlations/covariances (or your measurement instrument is terribly flawed). Please check the signs of the values in the correlation matrix and take corrective action.

Post by p***@gmail.com
I had analysed alpha cronbach but it was showing that The value is negative due to a negative average covariance among items. This violates reliability model assumptions. You may want to check item codings. im using scale 0 until 5. Perhaps, the problem is scale 0. please coment and share for this.

Rich Ulrich

2016-01-12 06:01:24 UTC

On Wed, 6 Jan 2016 10:03:50 -0800 (PST), David Marso

Post by David Marso
You obviously have something reverse scaled resulting in negative correlations/covariances (or your measurement instrument is terribly flawed). Please check the signs of the values in the correlation matrix and take corrective action.

Other than a bad scale: I have seen people fail to
exclude "Missing" and thus treat -9 or 999 (or some such)
and thus treat a few wild numbers as if they were scores.

--
Rich Ulrich

r***@gmail.com

2017-12-20 19:42:27 UTC

I am currently facing the same problem, but my case is that i am trying to test a "test" paper which has correct and incorrect answers, when i ran the data on SPSS my alpha came back as (-2.4), i don't know if i should test the reliability of a graded(right and wrong) test using SPSS or there is a different way to go about it. HELP!

Rich Ulrich

2017-12-24 02:23:37 UTC

Post by r***@gmail.com

I don't remember for sure whether negative r's make the formula
go that thoroughly kaput. Except for that, getting an alpha of
like -2.4 would sound like you have a corrupted SPSS which
would need to be re-installed. Are other procedures running
okay?

I hope you have read other posts in this usenet thread, which
mentions things like reverse-scoring items that need it.

Cronbach's alpha represents a transformation of the average
correlation. For positive correlations, it shows an shrinkage of the
"error" measured by (1- (average r)squared). This shrinkage depends
on the number of items; so the proper alpha is something larger
than the average (positive) correlation. So - Look at your matrix
of correlations. If there is an expectation of useful "internal
reliability", that means that you expect all the individual r's to be
positive.

The Wikipedia article on Cronbach's alpha has a simple formula
for using the average r's.

Also, for a dichtomy, I would probably not use Cronbach's, since
it is apt to come out smaller (and seemingly less impressive) than
the alphas which folks are used to seeing for scaled data.

[If the test is very long, I would be tempted to divide it into
subscales - according to a-priori judgment or factor analysis -
and then obtain the alpha across the subscales.]

--
Rich Ulrich

y***@gmail.com

2018-01-19 03:48:10 UTC

I'm having the same problem currently !
Can anyone pls hlp me
Thx a lot...

i***@gmail.com

2020-04-04 01:08:49 UTC

Me too

Rich Ulrich

2020-04-06 22:33:59 UTC

Post by i***@gmail.com
Me too

I see approximately 33 follow-ups to this thread from its
first posting in 2009. See -

https://groups.google.com/forum/#!topic/comp.soft-sys.stat.spss/IVp-wCTSxR8

I found this by Googling on
< "error message when I do a reliability analysis" >

--
Rich Ulrich

Amy Hester

2022-01-07 22:33:44 UTC