ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1803.07519
  4. Cited By
DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems
v1v2v3v4 (latest)

DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems

20 March 2018
Lei Ma
Felix Juefei Xu
Fuyuan Zhang
Jiyuan Sun
Minhui Xue
Yue Liu
Chunyang Chen
Ting Su
Li Li
Yang Liu
Jianjun Zhao
Yadong Wang
    ELM
ArXiv (abs)PDFHTML

Papers citing "DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems"

50 / 211 papers shown
SINVAD: Search-based Image Space Navigation for DNN Image Classifier
  Test Input Generation
SINVAD: Search-based Image Space Navigation for DNN Image Classifier Test Input Generation
Sungmin Kang
R. Feldt
S. Yoo
AAML
178
37
0
19 May 2020
Reliability and Robustness analysis of Machine Learning based Phishing
  URL Detectors
Reliability and Robustness analysis of Machine Learning based Phishing URL Detectors
Bushra Sabir
Muhammad Ali Babar
R. Gaire
A. Abuadbba
AAML
367
16
0
18 May 2020
Stealthy and Efficient Adversarial Attacks against Deep Reinforcement
  Learning
Stealthy and Efficient Adversarial Attacks against Deep Reinforcement Learning
Jianwen Sun
Tianwei Zhang
Xiaofei Xie
Lei Ma
Yan Zheng
Kangjie Chen
Yang Liu
AAML
155
136
0
14 May 2020
Online Monitoring for Neural Network Based Monocular Pedestrian Pose
  Estimation
Online Monitoring for Neural Network Based Monocular Pedestrian Pose Estimation
Arjun Gupta
Luca Carlone
3DH
169
9
0
11 May 2020
A Performance-Sensitive Malware Detection System Using Deep Learning on
  Mobile Devices
A Performance-Sensitive Malware Detection System Using Deep Learning on Mobile Devices
Ruitao Feng
Sen Chen
Xiaofei Xie
Guozhu Meng
Shang-Wei Lin
Yang Liu
197
121
0
11 May 2020
Towards Characterizing Adversarial Defects of Deep Learning Software
  from the Lens of Uncertainty
Towards Characterizing Adversarial Defects of Deep Learning Software from the Lens of Uncertainty
Xiyue Zhang
Xiaofei Xie
Lei Ma
Xiaoning Du
Q. Hu
Yang Liu
Jianjun Zhao
Meng Sun
AAML
149
88
0
24 Apr 2020
Testing Machine Translation via Referential Transparency
Testing Machine Translation via Referential Transparency
Pinjia He
Clara Meister
Z. Su
214
60
0
22 Apr 2020
$\text{A}^3$: Activation Anomaly Analysis
A3\text{A}^3A3: Activation Anomaly Analysis
Philip Sperl
Jan-Philipp Schulze
Konstantin Böttinger
187
6
0
03 Mar 2020
Bayes-TrEx: a Bayesian Sampling Approach to Model Transparency by
  Example
Bayes-TrEx: a Bayesian Sampling Approach to Model Transparency by Example
Serena Booth
Yilun Zhou
Ankit J. Shah
J. Shah
BDL
343
2
0
19 Feb 2020
Importance-Driven Deep Learning System Testing
Importance-Driven Deep Learning System TestingInternational Conference on Software Engineering (ICSE), 2020
Simos Gerasimou
Hasan Ferit Eniser
A. Sen
Alper Çakan
AAMLVLM
148
102
0
09 Feb 2020
Manifold for Machine Learning Assurance
Manifold for Machine Learning Assurance
Taejoon Byun
Sanjai Rayadurgam
160
33
0
08 Feb 2020
RAID: Randomized Adversarial-Input Detection for Neural Networks
RAID: Randomized Adversarial-Input Detection for Neural Networks
Hasan Ferit Eniser
M. Christakis
Valentin Wüstholz
AAML
249
17
0
07 Feb 2020
Teaching Software Engineering for AI-Enabled Systems
Teaching Software Engineering for AI-Enabled Systems
Jane Hsieh
Eunsuk Kang
SyDa
80
34
0
18 Jan 2020
ReluDiff: Differential Verification of Deep Neural Networks
ReluDiff: Differential Verification of Deep Neural NetworksInternational Conference on Software Engineering (ICSE), 2020
Brandon Paulsen
Jingbo Wang
Chao Wang
316
60
0
10 Jan 2020
Arachne: Search Based Repair of Deep Neural Networks
Arachne: Search Based Repair of Deep Neural NetworksACM Transactions on Software Engineering and Methodology (TOSEM), 2019
Jeongju Sohn
Sungmin Kang
S. Yoo
KELM
215
61
0
28 Dec 2019
Callisto: Entropy based test generation and data quality assessment for
  Machine Learning Systems
Callisto: Entropy based test generation and data quality assessment for Machine Learning SystemsInternational Conference on Information Control Systems & Technologies (ICST), 2019
Sakshi Udeshi
Xingbin Jiang
Sudipta Chattopadhyay
OOD
51
7
0
11 Dec 2019
Amora: Black-box Adversarial Morphing Attack
Amora: Black-box Adversarial Morphing AttackACM Multimedia (ACM MM), 2019
Run Wang
Felix Juefei Xu
Qing Guo
Yihao Huang
Xiaofei Xie
Lei Ma
Yang Liu
AAML
305
48
0
09 Dec 2019
Comparing Offline and Online Testing of Deep Neural Networks: An
  Autonomous Car Case Study
Comparing Offline and Online Testing of Deep Neural Networks: An Autonomous Car Case StudyInternational Conference on Information Control Systems & Technologies (ICST), 2019
Fitash Ul Haq
Donghwan Shin
S. Nejati
Lionel C. Briand
140
66
0
28 Nov 2019
Towards Security Threats of Deep Learning Systems: A Survey
Towards Security Threats of Deep Learning Systems: A Survey
Yingzhe He
Guozhu Meng
Kai Chen
Xingbo Hu
Jinwen He
AAMLELM
247
15
0
28 Nov 2019
DeepSmartFuzzer: Reward Guided Test Generation For Deep Learning
DeepSmartFuzzer: Reward Guided Test Generation For Deep Learning
Samet Demir
Hasan Ferit Eniser
A. Sen
AAML
144
32
0
24 Nov 2019
CAGFuzz: Coverage-Guided Adversarial Generative Fuzzing Testing of Deep
  Learning Systems
CAGFuzz: Coverage-Guided Adversarial Generative Fuzzing Testing of Deep Learning Systems
Pengcheng Zhang
Qiyin Dai
Patrizio Pelliccione
AAML
182
4
0
14 Nov 2019
There is Limited Correlation between Coverage and Robustness for Deep
  Neural Networks
There is Limited Correlation between Coverage and Robustness for Deep Neural Networks
Yizhen Dong
Peixin Zhang
Jingyi Wang
Shuang Liu
Jun Sun
Jianye Hao
Xinyu Wang
Li Wang
J. Dong
Ting Dai
OODAAML
141
33
0
14 Nov 2019
RNN-Test: Towards Adversarial Testing for Recurrent Neural Network
  Systems
RNN-Test: Towards Adversarial Testing for Recurrent Neural Network Systems
Jianmin Guo
Yue Zhao
Xueying Han
Yu Jiang
AAML
186
14
0
11 Nov 2019
DLA: Dense-Layer-Analysis for Adversarial Example Detection
DLA: Dense-Layer-Analysis for Adversarial Example DetectionEuropean Symposium on Security and Privacy (EuroS&P), 2019
Philip Sperl
Ching-yu Kao
Peng Chen
Konstantin Böttinger
AAML
125
36
0
05 Nov 2019
DeepSearch: A Simple and Effective Blackbox Attack for Deep Neural
  Networks
DeepSearch: A Simple and Effective Blackbox Attack for Deep Neural Networks
Fuyuan Zhang
Sankalan Pal Chowdhury
M. Christakis
AAML
176
8
0
14 Oct 2019
Operational Calibration: Debugging Confidence Errors for DNNs in the
  Field
Operational Calibration: Debugging Confidence Errors for DNNs in the Field
Zenan Li
Xiaoxing Ma
Chang Xu
Jingwei Xu
Chun Cao
Jian Lu
196
30
0
06 Oct 2019
Testing and verification of neural-network-based safety-critical control
  software: A systematic literature review
Testing and verification of neural-network-based safety-critical control software: A systematic literature reviewInformation and Software Technology (IST), 2019
Jin Zhang
Jingyue Li
219
56
0
05 Oct 2019
Software Engineering Meets Deep Learning: A Mapping Study
Software Engineering Meets Deep Learning: A Mapping Study
Fabio Ferreira
L. L. Silva
M. T. Valente
286
9
0
25 Sep 2019
An Empirical Study towards Characterizing Deep Learning Development and
  Deployment across Different Frameworks and Platforms
An Empirical Study towards Characterizing Deep Learning Development and Deployment across Different Frameworks and PlatformsInternational Conference on Automated Software Engineering (ASE), 2019
Qianyu Guo
Sen Chen
Xiaofei Xie
Lei Ma
Q. Hu
Hongtao Liu
Yang Liu
Jianjun Zhao
Xiaohong Li
162
130
0
15 Sep 2019
FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized
  Fake Faces
FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces
Run Wang
Felix Juefei Xu
Lei Ma
Xiaofei Xie
Yihao Huang
Jian-Xun Wang
Yang Liu
AAMLCVBM
327
57
0
13 Sep 2019
Testing Deep Learning Models for Image Analysis Using Object-Relevant
  Metamorphic Relations
Testing Deep Learning Models for Image Analysis Using Object-Relevant Metamorphic Relations
Yongqiang Tian
Shiqing Ma
Ming Wen
Yepang Liu
Shing-Chi Cheung
Xinming Zhang
VLM
122
6
0
06 Sep 2019
Data Sanity Check for Deep Learning Systems via Learnt Assertions
Data Sanity Check for Deep Learning Systems via Learnt Assertions
Haochuan Lu
Huanlin Xu
Nana Liu
Yangfan Zhou
Xin Wang
AAML
121
6
0
06 Sep 2019
Detecting Deep Neural Network Defects with Data Flow Analysis
Detecting Deep Neural Network Defects with Data Flow Analysis
Jiazhen Gu
Huanlin Xu
Yangfan Zhou
Xin Wang
Hui Xu
Michael Lyu
142
2
0
05 Sep 2019
Model Agnostic Defence against Backdoor Attacks in Machine Learning
Model Agnostic Defence against Backdoor Attacks in Machine LearningIEEE Transactions on Reliability (IEEE Trans. Reliab.), 2019
Sakshi Udeshi
Shanshan Peng
Gerald Woo
Lionell Loh
Louth Rawshan
Sudipta Chattopadhyay
AAML
249
116
0
06 Aug 2019
Structure-Invariant Testing for Machine Translation
Structure-Invariant Testing for Machine TranslationInternational Conference on Software Engineering (ICSE), 2019
Pinjia He
Clara Meister
Z. Su
251
115
0
19 Jul 2019
Machine Learning Testing: Survey, Landscapes and Horizons
Machine Learning Testing: Survey, Landscapes and HorizonsIEEE Transactions on Software Engineering (TSE), 2019
Jie M. Zhang
Mark Harman
Lei Ma
Yang Liu
VLMAILaw
271
822
0
19 Jun 2019
Boosting Operational DNN Testing Efficiency through Conditioning
Boosting Operational DNN Testing Efficiency through Conditioning
Zenan Li
Xiaoxing Ma
Chang Xu
Chun Cao
Jingwei Xu
Jian Lu
226
111
0
06 Jun 2019
Securing Connected & Autonomous Vehicles: Challenges Posed by
  Adversarial Machine Learning and The Way Forward
Securing Connected & Autonomous Vehicles: Challenges Posed by Adversarial Machine Learning and The Way ForwardIEEE Communications Surveys and Tutorials (COMST), 2019
A. Qayyum
Muhammad Usama
Junaid Qadir
Ala I. Al-Fuqaha
AAML
220
211
0
29 May 2019
Testing DNN Image Classifiers for Confusion & Bias Errors
Testing DNN Image Classifiers for Confusion & Bias ErrorsInternational Conference on Software Engineering (ICSE), 2019
Yuchi Tian
Ziyuan Zhong
Vicente Ordonez
Gail E. Kaiser
Baishakhi Ray
304
54
0
20 May 2019
Taking Care of The Discretization Problem: A Comprehensive Study of the
  Discretization Problem and A Black-Box Adversarial Attack in Discrete Integer
  Domain
Taking Care of The Discretization Problem: A Comprehensive Study of the Discretization Problem and A Black-Box Adversarial Attack in Discrete Integer DomainIEEE Transactions on Dependable and Secure Computing (TDSC), 2019
Lei Bu
Yuchao Duan
Fu Song
Zhe Zhao
AAML
372
23
0
19 May 2019
Assuring the Machine Learning Lifecycle: Desiderata, Methods, and
  Challenges
Assuring the Machine Learning Lifecycle: Desiderata, Methods, and ChallengesACM Computing Surveys (ACM CSUR), 2019
Rob Ashmore
R. Calinescu
Colin Paterson
AI4TS
221
132
0
10 May 2019
Test Selection for Deep Learning Systems
Test Selection for Deep Learning SystemsACM Transactions on Software Engineering and Methodology (TOSEM), 2019
Wei Ma
Mike Papadakis
Anestis Tsakmalis
Maxime Cordy
Yves Le Traon
OOD
148
103
0
30 Apr 2019
Towards Structured Evaluation of Deep Neural Network Supervisors
Towards Structured Evaluation of Deep Neural Network SupervisorsInternational Conference on Artificial Intelligence Testing (ICAIT), 2019
Jens Henriksson
C. Berger
Markus Borg
Lars Tornberg
Cristofer Englund
S. Sathyamoorthy
Stig Ursing
AAML
177
39
0
04 Mar 2019
Grammar Based Directed Testing of Machine Learning Systems
Grammar Based Directed Testing of Machine Learning SystemsIEEE Transactions on Software Engineering (TSE), 2019
Sakshi Udeshi
Sudipta Chattopadhyay
210
16
0
26 Feb 2019
DeepFault: Fault Localization for Deep Neural Networks
DeepFault: Fault Localization for Deep Neural Networks
Hasan Ferit Eniser
Simos Gerasimou
A. Sen
AAML
140
95
0
15 Feb 2019
Input Prioritization for Testing Neural Networks
Input Prioritization for Testing Neural Networks
Taejoon Byun
Vaibhav Sharma
Abhishek Vijayakumar
Sanjai Rayadurgam
D. Cofer
AAML
134
73
0
11 Jan 2019
DeepBillboard: Systematic Physical-World Testing of Autonomous Driving
  Systems
DeepBillboard: Systematic Physical-World Testing of Autonomous Driving Systems
Husheng Zhou
Wei Li
Yuankun Zhu
Yuqun Zhang
Bei Yu
Lingming Zhang
Cong Liu
AAML
183
201
0
27 Dec 2018
DeepCruiser: Automated Guided Testing for Stateful Deep Learning Systems
DeepCruiser: Automated Guided Testing for Stateful Deep Learning Systems
Xiaoning Du
Xiaofei Xie
Yi Li
Lei Ma
Jianjun Zhao
Yang Liu
152
43
0
13 Dec 2018
Superion: Grammar-Aware Greybox Fuzzing
Superion: Grammar-Aware Greybox Fuzzing
Peng Li
Bihuan Chen
Lei Wei
Yang Liu
238
272
0
04 Dec 2018
Boosting the Robustness Verification of DNN by Identifying the
  Achilles's Heel
Boosting the Robustness Verification of DNN by Identifying the Achilles's Heel
Chang-Xue Feng
Zhenbang Chen
W.-Y. Hong
Hengbiao Yu
Wei Dong
Ji Wang
AAML
137
1
0
17 Nov 2018
Previous
12345
Next