diff --git a/docs/changes/newsfragments/268.bugfix b/docs/changes/newsfragments/268.bugfix
deleted file mode 100644
index 338a56f84..000000000
--- a/docs/changes/newsfragments/268.bugfix
+++ /dev/null
@@ -1 +0,0 @@
-Fix usage of optuna distributions as hyperparameters in older versions of scikit-learn by `Fede Raimondo`_.
\ No newline at end of file
diff --git a/docs/changes/newsfragments/270.enh b/docs/changes/newsfragments/270.enh
deleted file mode 100644
index 63cd68890..000000000
--- a/docs/changes/newsfragments/270.enh
+++ /dev/null
@@ -1 +0,0 @@
-Remove final model fit requirement for inspector to be returned by :func:`.run_cross_validation` by `Fede Raimondo`_.
\ No newline at end of file
diff --git a/docs/changes/newsfragments/271.enh b/docs/changes/newsfragments/271.enh
deleted file mode 100644
index 00d7c240f..000000000
--- a/docs/changes/newsfragments/271.enh
+++ /dev/null
@@ -1 +0,0 @@
-Add :func:`.run_fit` that implements a model fitting procedure with the same API as :func:`.run_cross_validation` by `Fede Raimondo`_.
\ No newline at end of file
diff --git a/docs/changes/newsfragments/274.enh b/docs/changes/newsfragments/274.enh
deleted file mode 100644
index 4622b451d..000000000
--- a/docs/changes/newsfragments/274.enh
+++ /dev/null
@@ -1 +0,0 @@
-Optimise wrapping of steps and models in the pipeline only when a subset of features is being used, by `Fede Raimondo`_
\ No newline at end of file
diff --git a/docs/changes/newsfragments/275.enh b/docs/changes/newsfragments/275.enh
deleted file mode 100644
index a79cb03bf..000000000
--- a/docs/changes/newsfragments/275.enh
+++ /dev/null
@@ -1 +0,0 @@
-Place the final model CV split at the beginning instead of the end of the CV iterator wrapper by `Fede Raimondo`_
\ No newline at end of file
diff --git a/docs/changes/newsfragments/293.enh b/docs/changes/newsfragments/293.enh
deleted file mode 100644
index 216415a7b..000000000
--- a/docs/changes/newsfragments/293.enh
+++ /dev/null
@@ -1 +0,0 @@
-Change the internal logic of :func:`.run_cross_validation` to optimise joblib calls by `Fede Raimondo`_
\ No newline at end of file
diff --git a/docs/whats_new.rst b/docs/whats_new.rst
index dd36ea0c1..96ccb5d31 100644
--- a/docs/whats_new.rst
+++ b/docs/whats_new.rst
@@ -8,6 +8,31 @@ What's new
 
 .. towncrier release notes start
 
+Julearn 0.3.4 (2024-10-17)
+--------------------------
+
+Bugfixes
+^^^^^^^^
+
+- Fix usage of optuna distributions as hyperparameters in older versions of
+  scikit-learn by `Fede Raimondo`_. (:gh:`268`)
+
+
+Enhancements
+^^^^^^^^^^^^
+
+- Remove final model fit requirement for inspector to be returned by
+  :func:`.run_cross_validation` by `Fede Raimondo`_. (:gh:`270`)
+- Add :func:`.run_fit` that implements a model fitting procedure with the same
+  API as :func:`.run_cross_validation` by `Fede Raimondo`_. (:gh:`271`)
+- Optimise wrapping of steps and models in the pipeline only when a subset of
+  features is being used, by `Fede Raimondo`_ (:gh:`274`)
+- Place the final model CV split at the beginning instead of the end of the CV
+  iterator wrapper by `Fede Raimondo`_ (:gh:`275`)
+- Change the internal logic of :func:`.run_cross_validation` to optimise joblib
+  calls by `Fede Raimondo`_ (:gh:`293`)
+
+
 Julearn 0.3.3 (2024-05-16)
 --------------------------