Synthetic Data Generation of Surgical Drills Using Physics-Constrained GAN
- 1 Department of Electrical Engineering and Computer Science, University of Wyoming, Laramie, WY, USA
- 2 Department of Electrical Engineering and Computer Science, University of Wyoming, Laramie, WY, USA
- 3 Department of Electrical Engineering and Computer Science, University of Wyoming, Laramie, WY, USA
Abstract
Class imbalance in time series data occurs when some classes have far fewer training samples than others. Training a neural network classifier on such an imbalanced dataset results in bias and poor performance. In this paper, we focus on the class imbalance issue in a surgical bone-drilling dataset, where the drill traverses certain bone regions faster than others, leading to far fewer recorded samples in those regions. We propose a physics-constrained Generative Adversarial Network (P-GAN) that generates synthetic time-series data for underrepresented classes. Unlike standard generative models, the proposed P-GAN enforces physics constraints during the generation of synthetic samples. These constraints include ensuring depth and force values are within sensor-valid ranges and that depth sequences progress monotonically. Furthermore, these constraints enforce that the synthetic samples behave like real drill measurements. We evaluate the proposed method on the drill dataset by adding 150 synthetic sequences per underrepresented class and measure the effect on the model’s performance. Results on a drill dataset show consistent improvements in F1 scores for both GRU and CNN-based classifiers, suggesting that physical constraints are essential for generating useful synthetic data on small, domain-specific datasets.
- Blaney, J.A. and Muknahallipatna, S.S. (2024) An Evaluation of Deep Learning Models for Classifying Time Series Individual Data Instances. Journal of Computer and Communications , 12, 187-206. https://doi.org/10.4236/jcc.2024.1211014
- Hochreiter, S. and Schmidhuber, J. (1997) Long Short-Term Memory. Neural Computation , 9, 1735-1780. https://doi.org/10.1162/neco.1997.9.8.1735
- Cho, K., van Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H. and Bengio, Y. (2014) Learning Phrase Representations Using RNN Encoder-Decoder for Statis-Tical Machine Translation. arXiv: 1406.1078.
- He, K.M., Zhang, X.Y., Ren, S.Q. and Sun, J. (2016) Deep Residual Learning for Image Recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition ( CVPR ), Las Vegas, 27-30 June 2016, 770-778. https://doi.org/10.1109/CVPR.2016.90
- Szegedy, C., Liu, W., Jia, Y.Q., Sermanet, P., Reed, S., Anguelov, D., et al . (2015) Going Deeper with Convolutions. 2015 IEEE Conference on Computer Vision and Pattern Recognition ( CVPR ), Boston, 7-12 June 2015, 1-9. https://doi.org/10.1109/cvpr.2015.7298594
- EskandariNasab, M., Hamdi, S.M. and Boubrahimi, S.F. (2024) SeriesGAN: Time Series Generation via Adversarial and Autoregressive Learning. 2024 IEEE International Conference on Big Data ( BigData ), Washington, 15-18 December 2024, 860-869. https://doi.org/10.1109/bigdata62323.2024.10825115
- Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L. and Muller, P. (2019) Deep Learning for Time Series Classification: A Review. Data Mining and Knowledge Discovery , 33, 917-963. https://doi.org/10.1007/s10618-019-00619-1
- Fawaz, H.I., Forestier, G., Weber, J., Idoumghar, L. and Muller, P.A. (2018) Data Augmentation Using Synthetic Data for Time Series Classification with Deep Residual Networks. arXiv:1808.02455.
- Ismail Fawaz, H., Lucas, B., Forestier, G., Pelletier, C., Schmidt, D.F., Weber, J., et al . (2020) InceptionTime: Finding AlexNet for Time Series Classification. Data Mining and Knowledge Discovery , 34, 1936-1962. https://doi.org/10.1007/s10618-020-00710-y
- Yoon, J.S., Jarrett, D. and Van der Schaar, M. (2019) Time-Series Generative Adversarial Networks. 33 rd Conference on Neural Information Processing Systems ( NeurIPS 2019), Vancouver, 8-14 December 2019, 5508-5518.
- Arjovsky, M., Chintala, S. and Bottou, L. (2017) Wasserstein GAN. arXiv: 1701.07875.