OverlapBox sometimes not working as expected, Unity 2d

Question

I am using an overlap box to detect whether an arrow hits the ground or an enemy, the arrow hitting the enemy works, it's that often the arrow will just pass through the ground, not sure if I am missing something.

Heres my code for detecting the ground or enemy.

private void FixedUpdate()
{
    damageHit = Physics2D.OverlapBox(damagePosition.position, damageSize, whatIsEnemy);
    groundHit = Physics2D.OverlapBox(damagePosition.position, damageSize, whatIsGround);

    if (!hasHitGround)
        {

              if (damageHit)
            {
                Collider2D[] detectedObjects = Physics2D.OverlapBoxAll(damagePosition.position, damageSize, whatIsEnemy);

                  foreach (Collider2D collider in detectedObjects)
                {
                          IDamageable damageable = collider.GetComponent<IDamageable>();

                          if (damageable != null)
                    {
                        damageable.Damage(weaponData.attackDamage);
                        Destroy(gameObject);
                    }

                    IKnockbackable knockbackable = collider.GetComponent<IKnockbackable>();

                    if (knockbackable != null)
                    {
                        knockbackable.KnockBack(weaponData.knockbackAngle, weaponData.knockbackStrength, (int)Mathf.Sign(transform.rotation.y));
                    }
                }
            }

          if (groundHit)
            {
                rb.gravityScale = 0f;
                rb.velocity = Vector2.zero;
                hasHitGround = true;
                Destroy(gameObject, 10f);
            }
            else if (Mathf.Abs(xStartPos - transform.position.x) >= travelDistance && !isGravityOn)
            {
                isGravityOn = true;
                rb.gravityScale = gravity;


        }

        }

}

private void OnDrawGizmos()
{
    Gizmos.DrawWireCube(damagePosition.position, damageSize) ;
}

I thought that the hitbox may have been to small and it would just pass through wall due to not hitting it on any frame. After making the hitbox larger it still did not help, here you can see that even though the overlap box is overlaping the collider the arrow will continue on.