Skip to content

Commit

Permalink
fix
Browse files Browse the repository at this point in the history
  • Loading branch information
goliaro committed Mar 21, 2024
1 parent 19ea467 commit 3d355c7
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions src/c/flexflow_c.cc
Original file line number Diff line number Diff line change
Expand Up @@ -1539,6 +1539,11 @@ flexflow_tensor_t
Tensor aggregate_inputs[num_experts + 4] = {nullptr};
aggregate_inputs[0] = topk_coefficients;
aggregate_inputs[1] = topk_indices;
aggregate_inputs[2] = topk_indices;
// Note: we need to set the tensor below to a non-null value, but it is
// ignored (as it is not used in inference/finetuning)
aggregate_inputs[3] = topk_coefficients; // TODO: set this to full gate preds
// (to support training)
for (int i = 0; i < num_experts; i++) {
aggregate_inputs[i + 4] = FFCObjectWrapper::unwrap(expert_predictions_[i]);
}
Expand Down

0 comments on commit 3d355c7

Please sign in to comment.