Testing the on-demand detection of different AV with old malwares.

Discussion in 'Security and Viruses' started by sujay, Jul 17, 2010.

  1. sujay

    sujay Prominent Member

    Joined:
    Feb 23, 2010
    Messages:
    3,573
    Trophy Points:
    180
    Ratings:
    +50 / 1 / -0
    Hi Guys, I was testing the On-demand detection of different AV with some old malware collections. I will give you the information. But please understand that this malwares are almost 2 years old and there are some more tools in a security products to defend malwares. So, please take the results for informational purpose only. Please don't conclude anything.
    Also another problem with the test is that I could not perform the test at the same time. So, a malware which is not detected during my test may be detected now with the updated database. But chances are less because these are already very old samples. Remember I am not an expert. This is a amateur test only.
    Tested products until now.
    1. Immunet Free
    2. Immunet Pro
    3. Emsisoft Antimalware
    4. Avira Premium
    5. SAS Pro
    6. MBAM
    7. Digital Patrol
    8. K7 Antivirus
    9. eScan
    10. Dr.Web
    11. Clam Cloud
    12. Digital Defender
    13. Norman
    14. F-Prot AV
    15. Kaspersky
    16. Iobit360
    17. Spyemergency
    18. The Cleaner
    19. Trend Micro
    20. Hitman Pro
    21. Sophos
    22. Panda AV
    23. Advanced System Protector
    24. Eset
    25. FortiClient
    26. Solo Antivirus
    27. Twister Antivirus
    28. Ad-Aware Free
    29. AVG
    30. VBA32
    31. Quick Heal
    32. Rising
    33. AhnLab
    34. Jiangmin
    35. Kingsoft
    36. SpySweeper
    37. Vexira
    38. Avast
    39. Arcavir
    40. nProtect
    41. ViRobot
    42. Antiy
    43. Iolo
    44. Authentium
    45. Blue Point Security
    46. MSE
    47. Comodo
    48. Net Protector
    49. eAcceleration
    50. Zillya!
    51. Paretologic
    52. mks_vir
    53. Wuzzup
    54. Blink Personal
    55. Drive Sentry
    56. Spyware Terminator (w/o Clam AV)
    57. FSB Antivirus
    58. Norton Antivirus 2011 beta
    59. Trojan Remover
    60. Coranti
    61. Ashampoo
    62. Trustport
    63. Webroot
    64. Windows Defender
    65. My Free Antivirus
    66. F Secure
    67. Bullguard
    68. CA
    69. Cyber Defebder
    70. Norton 2010
    71. ByteHero
    72. Protector Plus
    73. MaxSecure Spyware Detector
    74. G Data
    75. Trojan Hunter
    78. MAXSECURE AV 2010
    79. MaxSecure Antivirus Pro 2010
    80. Norton Power Eraser
    81. CMC Antivirus
    82. ClamWin
    83. Counterspy
    84. Spyware Doctor
    85. Outpost AV
    86. Zone Alerm AV
    87. Bitdefender
    88. Eset AV
    89. McAfee
    90. BkAV Pro
    91. Tizer Secure
    92. Vipre
    93. VirIT Explorer


    [P.S: Immunet fails to quarantine almost all threats in an on-demand scan. So, for the free and pro version of Immunet I did the calculation by extracting malwares from an archive. In that way Immunet quarantines threat successfully. Also after that I scanned remaining threats multiple times to ensure that no threat is left which are detected by Immunet.](Problem seems to have solved now)


    Please suggest me if you want more products to be included.

    Set 1 contains 500 samples.

    Immunet free 414/500 (82.8%)
    Immunet Pro 495/500 (99%)
    Emsisoft Antimalware 500/500 (100%)
    Avira Premium 500/500 (100%)
    SAS Pro 406/500 (81.2%)
    MBAM 471/500 (94.2%)
    Digital Patrol 472/500 (94.4%)
    K7 441/500 (88.2%)
    eScan 493/500 (98.6%)
    Dr.Web 445/500 (89%)
    Clam Cloud 464/500 (92.8%)
    Digital Defender 393/500 (78.6%)
    Norman 483/500 (96.6%)
    F-Prot 442/500 (88.4%)
    Kaspersky 462/500 (92.4%)
    Iobit360 296/500 (59.2%)
    SpyEmergency 287/500 (57.4%)
    The Cleaner 40/500 (8%)
    TrendMicro 472/500 (94.4%)
    Hitman Pro 472/500 (94.4%)
    Sophos 456/500 (91.2%)
    Panda 490/500 (98%)
    Advanced System Protector 466/500 (93.2%)
    Eset 478/500 (95.6%)
    Forticlient 486/500 (97.2%)
    Solo 104/500 (20.8%)
    Twister 497/500 (99.4%)
    Ad-Aware Free 480/500 (96%)
    AVG 467/500 (93.4%)
    VBA32 462/500 (92.4%)
    Quick Heal 448/500 (89.6%)
    Rising 384/500 (76.8%)
    AhnLab 462/500 (92.4%)
    Jiangmin 464/500 (92.8%)
    Kingsoft 461/500 (92.2%%)
    SpySweeper 200/500 (40%)
    Vexira 461/500 (92.2%)
    Avast 486/500 (97.2%)
    Arcavir 460/500 (92%)
    nProtect 485/500 (97%)
    ViRobot 439/500 (87.8%)
    Antiy 463/500 (92.6%)
    Iolo 322/500 (64.4%)
    Authentium 479/500 (95.8%)
    Blue Point Security 499/500 (99.8%)
    MSE 464/500 (92.8%)
    Comodo 495/500 (99%)
    Net Protector 2010 334/500 (66.8%)
    eAcceleration 472/500 (94.4%)
    Zillya! 469/500 (93.8%)
    Paretologic 474/500 (94.8%)
    mks_vir 321/500 (64.2%)
    Wuzzup 474/500 (94.8%)
    Blink 491/500 (98.2%)
    Drive Sentry 491/500 (98.2%)
    Spyware Terminator 429/500 (85.8%)
    FSB AV 471/500 (94.2%)
    Norton 2011 beta 465/500 (93%)
    Trojan Remover 80/500
    Coranti 499/500 (99.8%)
    Ashampoo 497/500 (99.4%)
    Trustport 493/500 (98.6%)
    Webroot 466/500 (93.2%)
    Windows defender 223/500 (44.6%)
    My Free Antivirus 444/500 (88.8%)
    F-Secure 493/500 (98.6%)
    Bullguard 494/500 (98.8%)
    CA 326/500 (61.4%)
    Cyberdefender 355/500 (71%)
    Norton 2010 464/500 (92.8%)
    ByteHero 218/500 (43.6%)
    Protector plus 170/500 (25.4%)
    Maxsecure spyware detector 335/500
    G Data 497/500 (99.4%)
    Trojan Hunter 216/500 (43.2%)
    MAXSECURE AV 2010 500/500 (100%)
    MaxSecure Antivirus Pro 2010 453/500 (90.6%)
    Norton Power Eraser 468/500 (93.6%)
    CMC Antivirus 357/500 (71.4%)
    Clamwin 406/500 (81.2%)
    Counterspy 442/500 (88.4%)
    Spyware Doctor 478/500
    Outpost 408/500
    Zone Alerm 451/500 (90.2%)
    Bitdefender 492/500 (98.4%)
    Eset 478/500 (95.6%)
    McAfee 486/500
    BKAv Pro 452/500
    Tizer Secure 59/500 (11.8%)
    Vipre 460/500
    VirIT eXplorer 86/500


    Set 2 contains 5000 samples.

    Immunet free 2469/5000 (49.38%)
    Immunet Pro 4903/5000 (98.06%)
    Emsisoft Antimalware 4986/5000 (99.72%)
    Avira Premium 4961/5000 (99.22%)
    SAS Pro 223/5000 (4.46%)
    MBAM 150/5000 (3%)
    Digital Patrol 4829/5000 (96.58%)
    K7 3308/5000 (66.16%)
    eScan 4718/5000 (94.36%)
    Dr.Web 4590/5000 (91.8%)
    Clam Cloud 2470/5000 (49.4%)
    Digital Defender 3485/5000 (69.7%)
    Norman 4459/5000 (89.18%)
    F-Prot 4014/5000 (80.28%)
    Kaspersky 4924/5000 (98.48%)
    Iobit360 2183/5000 (43.66%)
    SpyEmergency 1274/5000 (25.48%)
    The Cleaner 410/5000 (8.2%)
    Trend Micro 4761/5000 (95.22%)
    Hitman Pro 2959/5000 (41.58%)
    Sophos 4800/5000 (95.6%)
    Panda 4723/5000 (94.46%)
    Advanced System Protector 3231/5000 (64.62%)
    Eset 4497/5000 (89.94%)
    Forticlient 4900/5000 (98%)
    Solo 2793/5000 (55.86%)
    Twister 4950/5000(99%)
    Ad-Aware 2922/5000 (58.44%)
    AVG 4669/5000(93.38%)
    VBA32 4591/5000 (91.82%)
    Quick Heal 2961/5000 (59.22%)
    Rising 3747/5000 (74.94%)
    AhnLab 4109/5000 (82.18%)
    Jiangmin 3649/5000 (72.98%)
    Kingsoft 3751/5000 (75.02%)
    SpySweeper 1571/5000 (31.42%)
    Vexira 4245/5000 (84.9%)
    Avast 4867/5000 (97.34%)
    Arcavir 4839/5000 (96.78%)
    nProtect 4851/5000 (97.02%)
    ViRobot 4806/5000 (96.12%)
    Antiy 4000/5000 (80%)
    iolo 4329/5000 (86.58%)
    Authentium 4868/5000 (97.36%)
    Blue Point Security 4972/5000 (99.44%)
    MSE 4654/5000 (93.08%)
    Comodo 4980/5000 (99.6%)
    PC Tools Free 4461/5000 (89.22%)
    Net Protector 256/5000 (5.12%)
    eAcceleration 4806/5000 (96.12%)
    Zillya 4067/5000 (81.34%)
    Paretologic 4948/5000 (98.96%)
    mks_vir 4710/5000 (94.2%)
    Wuzzup 1266/5000 (25.32%)
    Blink 4602/5000 (92.04%)
    Drive Sentry 1306/5000 (26.12%)
    Spyware Terminator 723/5000 (14.46%)
    FSB AV 2802/5000 (56.04%)
    Norton 2011 beta 4251/5000 (85.02%)
    Trojan Remover 74/5000
    Coranti 4965/5000(99.3%)
    Ashampoo 4977/5000 (99.54%)
    Trustport 4972/5000 (99.48%)
    Webroot 4853/5000 (97.06%)
    Windows Defender 704/5000 (14.08%)
    My Free Antivirus 3858/5000 (77.16%)
    F-Secure 4948/5000 (98.96%)
    Bullguard 4947/5000 (98.94%)
    CA 3027/5000 (60.54%)
    Cyberdefender 3873/5000 (77.46%)
    Norton 2010 4410/5000 (88.2%)
    ByteHero 849/5000 (16.98%)
    Protector Plus 3400/5000 (68%)
    MAxsecure spyware detector 1522/5000
    G Data 4970/5000 (99.4%)
    Trojan Hunter 476/5000
    Maxsecure AV 2010 4953/5000 (99.06%)
    MaxSecure Antivirus Pro 2010 2348/5000 (46.96%)
    Norton Power eraser 283/5000 (5.66%)
    CMC Antivirus 4880/5000 (97.6%)
    ClamWin 3679/5000 (73.58%)
    Counterspy 2160/5000 (43.2%)
    Spyware Doctor 4877/5000
    Outpost 4497/5000 (89.94%)
    Zone Alerm 4086/5000 (81.72%)
    Bitdefender 4914/5000 (98.28%)
    Eset 4555/5000 (91.1%)
    McAfee 4915/5000 (98.3%)
    BkAV Pro 3276/5000 (65.52%)
    Tizer Secure 229/5000 (4.58%)
    Vipre 2246/5000
    VirIT Explorer 865/5000


    For Updates see here
    http://forum.raymond.cc/spyware-vir...erent-av-with-old-malwares-12.html#post192822

    Results in a sequential manner here
    http://forum.raymond.cc/spyware-vir...erent-av-with-old-malwares-15.html#post193536
     

    Last edited by a moderator: Aug 5, 2010
  2. sm1

    sm1 Notable Member

    Joined:
    Nov 3, 2009
    Messages:
    828
    Trophy Points:
    68
    Ratings:
    +4 / 0 / -0
    Thanks Sujay for the test:). Big difference between Immunet free and pro. I think the pro version uses bitdefender engine.
     
  3. sujay

    sujay Prominent Member

    Joined:
    Feb 23, 2010
    Messages:
    3,573
    Trophy Points:
    180
    Ratings:
    +50 / 1 / -0
    You are welcome..:) Yes Immunet Pro uses Bitdefender engine...
     
  4. 7even

    7even Regular Member

    Joined:
    Dec 5, 2009
    Messages:
    76
    Trophy Points:
    16
    Ratings:
    +0 / 0 / -0
    I'm also disappointed with the results of SAS and MBAM. Too bad for these users favorite.
     
  5. sujay

    sujay Prominent Member

    Joined:
    Feb 23, 2010
    Messages:
    3,573
    Trophy Points:
    180
    Ratings:
    +50 / 1 / -0
    Dude its not a complete AV and IMO in the second set the proportion of Virus is greater. Also these are old malwares and many vendors don't like to incorporate old malwares into database.
     
  6. LunarWolf

    LunarWolf Prominent Member

    Joined:
    Jan 15, 2009
    Messages:
    2,151
    Trophy Points:
    166
    Ratings:
    +0 / 0 / -0
    @sujay, nice one!

    Any hopes of you showing kaspersky, eset and avast free v5?

    MBAM did alright for the 1st set. BUt I am still satisfied with it. Because it is one of the tool I used to clean an infected pc.
     
  7. sujay

    sujay Prominent Member

    Joined:
    Feb 23, 2010
    Messages:
    3,573
    Trophy Points:
    180
    Ratings:
    +50 / 1 / -0
    Thank you lunar. I will test KIS, Avast and eset for sure but I have many in the list. But I think at first I will try less popular ones. Next result will be published in a hour...:D
     
  8. keypees2005

    keypees2005 Notable Member

    Joined:
    Jun 22, 2009
    Messages:
    528
    Trophy Points:
    66
    Ratings:
    +0 / 0 / -0
    Good job, if possible, try to include more AVs.
     
  9. sujay

    sujay Prominent Member

    Joined:
    Feb 23, 2010
    Messages:
    3,573
    Trophy Points:
    180
    Ratings:
    +50 / 1 / -0
    Thanks keypass2005 ..:)
     
  10. hellnoire

    hellnoire *nix Technical Support

    Joined:
    Jan 24, 2009
    Messages:
    8,914
    Trophy Points:
    266
    Ratings:
    +0 / 0 / -0
    So you completely turned off the real time scanners for this?
     

Share This Page...